-- Logs begin at Mon 2022-09-26 00:56:54 UTC, end at Mon 2022-09-26 01:53:30 UTC. -- Sep 26 01:27:32.470472 dv-cinder-859203-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 01:27:32.479183 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 01:27:32 2022] *** Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: nodename: dv-cinder-859203-2-iscsi Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: machine: x86_64 Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: clock source: unix Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: pcre jit disabled Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: detected number of CPU cores: 4 Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: current working directory: / Sep 26 01:27:32.481149 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: detected binary path: /usr/bin/uwsgi-core Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: your processes number limit is 47680 Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: your memory page size is 4096 bytes Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: detected max file descriptor number: 2048 Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: lock engine: pthread robust mutexes Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: thunder lock: enabled Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 01:27:32.481852 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 01:27:32.521357 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: Python main interpreter initialized at 0x562bc90699c0 Sep 26 01:27:32.521357 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: python threads support enabled Sep 26 01:27:32.521357 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: your server socket listen backlog is limited to 100 connections Sep 26 01:27:32.521357 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: your mercy for graceful operations on workers is 90 seconds Sep 26 01:27:32.521675 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 01:27:32.521756 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: *** Operational MODE: preforking *** Sep 26 01:27:32.521989 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: *** uWSGI is running in multiple interpreter mode *** Sep 26 01:27:32.521989 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: spawned uWSGI master process (pid: 105620) Sep 26 01:27:32.522179 dv-cinder-859203-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 01:27:32.523220 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: spawned uWSGI worker 1 (pid: 105621, cores: 1) Sep 26 01:27:32.523220 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: spawned uWSGI worker 2 (pid: 105622, cores: 1) Sep 26 01:27:32.523220 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 01:27:33.184865 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 01:27:33.186396 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 01:27:34.276768 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:27:34.276768 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: from cryptography.utils import int_from_bytes Sep 26 01:27:34.277356 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:27:34.277356 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: from cryptography.utils import int_from_bytes Sep 26 01:27:34.280550 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:27:34.280550 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: from cryptography.utils import int_from_bytes Sep 26 01:27:34.281005 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:27:34.281005 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: from cryptography.utils import int_from_bytes Sep 26 01:27:36.803000 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:27:36.803558 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:27:36.803771 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:27:36.804126 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:27:36.804396 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:27:36.804776 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.805057 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:27:36.805439 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.805524 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:27:36.805601 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.805691 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.805829 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:27:36.806013 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.806185 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:27:36.806320 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.806421 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:27:36.806636 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.806802 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.806949 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807125 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807269 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807449 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807544 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807765 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.807868 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808091 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808218 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859203-2-iscsi {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808431 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808534 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808751 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.808837 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809054 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809140 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809370 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809456 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809624 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.809714 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.810478 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.810640 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.810824 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.810979 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859203-2-iscsi {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.811456 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.811542 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.811769 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.811911 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812086 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812208 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812572 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812730 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.812853 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813051 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813183 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813356 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813453 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813744 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.813852 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814048 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814164 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814371 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814461 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814679 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.814774 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815080 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815166 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859203-2-iscsi {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815392 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815476 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815697 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.815783 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816004 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816089 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816309 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816429 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816652 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816742 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.816960 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817049 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817320 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817411 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859203-2-iscsi {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817637 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817726 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.817943 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818039 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818258 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818353 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818571 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818670 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818885 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.818987 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819200 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819288 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819497 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819583 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819802 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.819969 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820113 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820207 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820451 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820542 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820754 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.820853 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821054 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821142 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821300 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821387 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821603 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821692 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.821918 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822006 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822231 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822325 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822548 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822650 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822792 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.822880 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823039 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823184 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823351 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823440 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823662 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823750 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.823966 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824066 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824269 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824596 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824692 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824846 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.824934 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.825094 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.825181 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.825408 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.825501 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.826376 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.826470 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.826794 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.826886 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827121 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827214 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827434 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827528 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827738 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.827823 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.828046 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.828144 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.828391 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.828730 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.828931 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829030 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829235 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829330 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829547 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829641 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829859 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.829945 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830179 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830274 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830484 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830577 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830797 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.830891 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831112 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831417 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831505 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831717 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.831817 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832019 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832115 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832333 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832442 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832683 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832780 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.832978 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833067 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833225 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833319 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833522 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833609 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833822 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.833919 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834134 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834221 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834437 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834534 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834740 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.834834 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835040 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835127 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835311 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835396 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835608 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835696 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835909 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.835997 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836209 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836304 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836534 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836623 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836836 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.836923 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837136 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837230 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837433 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837520 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837731 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.837864 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838031 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838132 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838329 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838473 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838629 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838716 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.838929 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839032 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839231 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839325 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839529 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839615 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839828 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.839930 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840127 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840218 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840453 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840544 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840756 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.840855 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841059 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841193 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841448 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841537 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841754 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.841964 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842054 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842274 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842369 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842582 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842690 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.842901 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843002 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843203 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843298 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843506 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843602 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843807 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.843893 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844113 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844199 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844439 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844544 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844742 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.844828 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845039 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845135 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845339 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845440 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845636 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845730 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.845934 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846020 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846231 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846325 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846529 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846617 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846821 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.846915 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847120 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847282 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847420 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847507 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847720 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.847806 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848019 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848106 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848316 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848430 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848638 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848741 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.848936 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.849025 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.849230 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.849325 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.849541 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.849629 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.849855 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.849950 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.850160 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.850246 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.850463 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.850557 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.850764 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.850850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.851076 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:27:36.851164 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.851405 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.851506 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.851723 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.851810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852031 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852124 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852336 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852463 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852662 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852749 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.852977 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853075 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853288 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853384 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853595 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853680 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853905 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.853999 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854215 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854322 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854520 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854615 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854826 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.854916 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855128 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855222 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855443 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855529 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855757 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.855842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856064 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856161 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856399 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856489 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856713 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.856812 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.857120 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.857230 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.857440 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.857741 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.857841 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858051 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858146 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858357 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858446 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858665 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858772 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.858996 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859097 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859307 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859403 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859614 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859701 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.859931 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860019 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860241 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860353 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860584 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860673 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860894 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.860982 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861199 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861285 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861504 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861589 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861809 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.861897 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862138 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862225 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862451 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862538 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862768 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.862856 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863081 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863179 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863397 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863485 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863708 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.863797 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864016 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864103 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864321 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864478 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864651 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864738 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.864957 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865055 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865259 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865356 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865560 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865649 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865860 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.865955 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866165 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866261 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866464 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866552 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866780 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.866866 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867088 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867183 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867396 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867484 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867704 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.867790 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868008 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868096 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868307 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868422 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868633 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868783 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.868938 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869026 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869237 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869326 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869547 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869633 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869852 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.869950 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870153 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870240 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870469 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870559 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870770 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.870856 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871068 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871154 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871372 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871466 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871673 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871759 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.871971 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.872056 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.872278 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.872891 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.873148 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.873264 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.873458 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.873703 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.873803 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874032 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874122 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874344 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874431 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874649 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874736 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.874953 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875048 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875261 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875347 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875568 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875664 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875882 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.875970 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876191 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876280 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876524 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876627 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876835 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.876931 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877132 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877218 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877437 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877533 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877740 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.877829 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878042 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878131 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878342 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878439 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878648 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878737 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.878946 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879037 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879245 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879334 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879543 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879632 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879842 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.879930 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880146 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880234 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880482 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880573 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880786 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.880872 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881102 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881196 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881379 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881466 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881676 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881765 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.881972 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882067 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882273 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882361 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882571 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882667 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882871 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.882968 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883168 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883313 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883483 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883581 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883785 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.883874 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884084 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884180 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884407 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884509 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884708 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.884795 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885027 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885124 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885331 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885431 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885644 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885729 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.885949 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886036 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886263 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886352 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886568 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886663 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886874 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.886960 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887177 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887263 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887479 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887572 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887776 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.887876 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.888639 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.888740 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.889110 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.889324 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.889510 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.889681 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.889779 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890001 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890090 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890324 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890419 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890635 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890731 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.890957 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891102 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891266 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891355 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891573 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891661 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891876 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.891963 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892189 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892277 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892519 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892616 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892835 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.892922 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893140 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893229 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893459 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893557 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893765 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.893851 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894073 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894159 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894372 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894467 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894677 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894763 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.894985 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895081 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895295 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895382 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895607 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895693 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.895912 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896011 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896227 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896322 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896556 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896645 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896862 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.896957 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897165 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897261 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897468 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897561 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897769 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.897865 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898073 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898159 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898385 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898472 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898693 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898790 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.898998 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899085 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899304 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899398 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899624 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899717 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.899935 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900038 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900244 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900331 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900578 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900668 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900883 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.900970 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901185 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901272 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901492 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901581 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901806 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.901894 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902114 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902210 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902415 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902502 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902716 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.902810 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903028 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903124 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903331 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903657 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.903748 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.904065 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.904208 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.904383 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.904679 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.904777 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905009 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905105 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905315 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905444 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905628 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905725 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.905945 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906033 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906250 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906345 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906555 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906643 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906857 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.906951 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907162 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907251 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907461 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907546 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907762 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.907858 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908063 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908157 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908390 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908492 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908698 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.908797 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909004 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909093 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909311 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909405 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909626 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909725 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.909932 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910025 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910239 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910326 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910546 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910633 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910843 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.910929 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.911150 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.911244 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.911459 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.911554 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.911766 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912018 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912105 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912380 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912484 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912684 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912772 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.912988 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913073 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913310 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913406 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913617 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913714 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.913927 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914013 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914234 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914322 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914537 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914625 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914837 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.914930 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.915144 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.915241 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.915445 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.915698 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.915790 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916026 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916114 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916325 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916435 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916645 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916733 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.916947 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917034 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917254 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917359 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917554 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917651 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917854 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.917942 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918153 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918250 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918453 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918541 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918764 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.918859 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.919067 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.919164 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.919443 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.919557 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.919746 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920060 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920160 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920381 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920473 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920685 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920773 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.920984 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921085 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921284 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921382 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921596 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921685 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921901 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.921999 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922203 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922300 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922506 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922594 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.922915 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923118 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923206 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923426 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923515 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923728 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.923895 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924033 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924120 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924334 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924438 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924658 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.924961 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925054 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925261 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925347 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925557 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925693 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.925953 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926168 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926254 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926472 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926561 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926773 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.926861 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927070 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927165 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927372 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927460 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927671 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927771 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.927981 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928079 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928285 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928427 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928609 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928697 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.928908 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929006 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929297 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929510 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929597 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929812 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.929912 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930117 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930213 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930416 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930503 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930717 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.930815 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931015 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931102 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931312 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931399 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931609 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931703 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931911 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.931997 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932215 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932308 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932539 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932627 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932837 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.932924 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933144 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933232 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933443 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933530 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933740 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.933873 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934044 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934130 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934341 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934435 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934640 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.934726 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.935465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.935569 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.935787 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936011 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936100 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936335 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936667 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936762 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.936978 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937065 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937281 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937368 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937580 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937667 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937886 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.937991 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938183 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938271 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938482 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938569 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938780 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.938866 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939081 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939177 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939377 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939517 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939684 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939780 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.939987 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940081 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940289 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940615 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940704 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.940915 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941011 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941216 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941302 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941518 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941617 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941819 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.941914 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942126 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942212 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942511 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942725 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.942814 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943023 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943109 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943323 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943418 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943622 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943712 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.943939 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944027 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944243 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944330 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944567 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944659 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944868 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.944954 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945169 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945255 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945471 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945795 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.945910 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946105 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946213 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946410 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946499 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946726 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.946814 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947039 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947350 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947437 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947647 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947740 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.947950 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948045 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948249 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948334 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948575 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948660 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948881 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.948981 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.949185 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.949274 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.949486 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.949621 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.949792 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.950048 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.950147 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.950442 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.950647 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.950964 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951093 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951278 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951391 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951583 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951698 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.951894 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952028 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952202 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952335 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952531 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952654 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.952855 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953092 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953229 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953348 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953430 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953762 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.953992 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954081 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954292 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954380 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954600 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954695 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954900 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.954989 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955219 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955306 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955528 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955615 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955830 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.955934 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956140 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956239 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956471 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956575 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956775 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.956865 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957096 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957184 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957401 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957502 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957699 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.957792 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958002 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958110 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958305 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958402 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958613 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958702 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.958916 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959003 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959287 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959381 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959584 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959728 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959889 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.959982 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960210 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960306 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960540 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960629 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960841 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.960927 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961140 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961240 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961453 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961541 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961749 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.961837 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962063 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962151 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962453 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962547 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962760 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.962854 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963059 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963146 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963358 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963465 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963657 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963771 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.963963 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964075 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964280 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964411 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964605 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964727 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.964905 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965046 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965205 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965346 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965522 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965653 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965820 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.965947 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.966703 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.966818 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967078 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967330 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967426 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967636 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967725 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.967945 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968033 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968267 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968403 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968610 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968700 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.968919 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969007 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969235 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969322 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969597 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969684 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.969921 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970012 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970225 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970537 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970625 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970843 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.970932 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971145 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971244 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971447 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971537 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971755 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.971849 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972056 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972156 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972473 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972578 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972689 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972784 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.972993 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973091 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973301 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973389 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973608 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973696 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.973913 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974002 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974215 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974324 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974515 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974635 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974836 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.974956 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975237 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975334 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975560 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975648 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975862 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.975950 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976174 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976262 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976500 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976591 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.976935 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977131 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977231 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977431 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977527 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977732 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.977825 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978032 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978120 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978333 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978428 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978632 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978727 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.978932 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979020 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979251 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979352 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979558 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979647 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.979875 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980010 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980182 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980278 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980523 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980611 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980841 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.980928 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.981160 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.981258 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.981452 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.981539 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.981776 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.982391 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.982761 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.982857 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983068 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983267 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983356 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983581 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983678 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.983926 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984014 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984236 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984478 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984569 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984662 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984856 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.984945 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.985158 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.985247 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.985460 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.985557 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.985874 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986006 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986268 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986419 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986647 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986797 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.986973 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987117 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987281 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987433 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987584 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987757 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.987885 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988064 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988181 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988388 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988538 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988702 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.988839 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989008 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989164 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989313 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989470 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989622 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989793 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.989931 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990106 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990233 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990417 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990535 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990734 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.990822 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991043 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991140 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991352 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991441 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991662 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991749 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.991973 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992074 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992278 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992382 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992628 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992717 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.992931 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993021 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993240 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993327 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993558 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993769 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.993901 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994099 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994194 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994411 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994500 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994721 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.994822 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995031 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995120 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995341 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995436 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995648 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995749 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.995954 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996043 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996261 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996408 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996593 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996693 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996898 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.996993 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.997212 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.997303 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.997559 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.997667 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.997870 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.998149 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.998267 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.998501 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.998682 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.998812 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999015 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999124 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999332 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999429 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999653 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999773 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:36.999997 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000132 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000268 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000502 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000617 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000824 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.000921 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001139 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001228 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001452 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001544 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001762 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.001850 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002069 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002175 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002380 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002478 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002690 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002786 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.002997 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003094 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003304 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003393 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003612 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003701 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.003921 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004011 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004239 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004329 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004593 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004684 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.004910 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005000 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005213 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005300 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005520 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005607 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005830 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.005920 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006142 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006342 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006452 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006649 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006764 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.006974 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007070 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007293 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007382 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007610 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007708 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.007921 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008010 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008233 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008400 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008657 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008870 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.008959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009172 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009270 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009477 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009782 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.009870 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010080 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010181 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010396 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010488 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010705 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.010906 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011039 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011217 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011313 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011545 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011633 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.011866 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012110 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012474 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012788 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.012878 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.013131 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.013227 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.013631 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.013922 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014011 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014249 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014346 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014562 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014695 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014881 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.014968 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015188 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015285 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015493 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015579 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015794 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.015882 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016107 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016208 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016439 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016537 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016744 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.016966 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017068 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017307 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017403 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017621 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017709 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.017929 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018024 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018231 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018319 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018548 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018636 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018847 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.018943 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019149 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019238 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019448 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019538 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019750 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.019851 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020047 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020134 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020390 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020494 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020668 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020756 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.020969 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021124 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021276 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021365 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021573 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021668 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021871 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.021958 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022166 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022253 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022463 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022552 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022784 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.022935 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023085 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023181 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023386 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023476 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023688 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023776 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.023990 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024089 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024288 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024404 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024614 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024703 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.024917 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025015 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025216 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025304 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025522 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025610 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025822 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.025920 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026127 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026215 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026425 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026514 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026731 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.026981 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027077 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027315 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027441 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027636 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027734 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.027959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.028046 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.028258 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.028395 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.028579 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.029242 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.029442 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.029533 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.029748 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030027 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030114 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030357 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030447 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030665 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030753 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.030973 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031069 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031280 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031378 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031590 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031679 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.031895 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032134 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032224 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032489 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032593 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032811 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.032900 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033114 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033203 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033418 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033514 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033722 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.033811 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034025 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034116 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034325 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034411 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034633 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034729 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.034940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035019 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035250 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035328 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035560 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035648 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035869 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.035948 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036176 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036254 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036505 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036603 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036812 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.036889 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037115 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037191 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037418 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037496 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037725 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.037803 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038033 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038117 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038340 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038429 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038642 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038720 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.038947 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.039258 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.039344 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.039597 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.039675 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.039914 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040005 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040232 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040310 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040566 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040655 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040879 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.040964 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041186 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041265 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041492 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041568 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041794 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.041871 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042098 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042187 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042407 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042495 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042730 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.042828 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043040 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043128 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043343 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043431 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043650 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.043958 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.044072 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.044299 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.044966 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.045337 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.045511 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.045620 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.045937 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.046097 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.046239 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.046547 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.046654 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.046859 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047019 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047152 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047350 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047445 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047669 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047764 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.047993 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048087 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048306 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048421 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048638 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048731 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.048941 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049530 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049606 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049685 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049754 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049828 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049898 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.049972 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050109 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050231 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050411 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050494 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050711 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.050814 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051012 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051103 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051316 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051406 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051617 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051707 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.051918 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052009 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052241 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052328 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052655 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052869 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.052960 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053215 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053309 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053471 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053560 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053776 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.053868 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054077 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054167 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054378 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054474 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054677 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054767 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.054975 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055065 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055273 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055370 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055573 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055666 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055879 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.055978 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056179 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056277 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056505 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056596 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056806 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.056895 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057106 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057208 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057406 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057503 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057729 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.057816 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058054 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058151 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058357 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058446 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058673 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058768 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.058979 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059077 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059293 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059380 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059595 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059682 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.059923 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.060019 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.060507 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.060743 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.060875 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061066 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061165 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061379 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061468 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061693 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.061791 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062008 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062097 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062320 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062408 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062627 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062724 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.062935 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063024 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063244 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063331 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063555 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063652 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063867 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.063956 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064168 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064255 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064515 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064617 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064827 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.064914 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065142 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065242 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065454 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065592 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065763 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.065860 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066087 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066176 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066396 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066486 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066704 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.066800 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067012 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067100 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067319 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067410 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067625 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067720 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.067865 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:27:37.067954 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.068233 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.068563 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.068924 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.069244 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.069569 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.069892 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.070206 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.070529 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.070851 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.071195 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.071505 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.071846 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.072169 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.072502 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.072814 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.073116 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:27:37.073355 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:27:37.222519 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO dbcounter [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Registered counter for database nova_api Sep 26 01:27:37.229166 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO dbcounter [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Registered counter for database nova_api Sep 26 01:27:37.242890 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.249960 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_db.sqlalchemy.engines [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.250134 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writer thread running {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.256447 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writer thread running {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.306563 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.context [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12c9fd8-f951-4e80-91ce-c97b9492891c(cell1) {{(pid=105622) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 01:27:37.310929 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:27:37.311531 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:27:37.313107 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:27:37.313832 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:27:37.314111 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.context [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12c9fd8-f951-4e80-91ce-c97b9492891c(cell1) {{(pid=105621) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 01:27:37.314262 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:27:37.316248 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:27:37.318030 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:27:37.318249 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO dbcounter [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Registered counter for database nova_cell0 Sep 26 01:27:37.318506 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:27:37.320070 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:27:37.320839 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:27:37.321287 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:27:37.322274 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO dbcounter [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Registered counter for database nova_cell1 Sep 26 01:27:37.323270 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_concurrency.lockutils [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:27:37.325296 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO dbcounter [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Registered counter for database nova_cell0 Sep 26 01:27:37.329845 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO dbcounter [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Registered counter for database nova_cell1 Sep 26 01:27:37.330013 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.331960 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.336777 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_db.sqlalchemy.engines [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.337056 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writer thread running {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.338195 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_db.sqlalchemy.engines [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.339678 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writer thread running {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.344706 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writer thread running {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.346521 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writer thread running {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.494608 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO dbcounter [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Registered counter for database nova_cell0 Sep 26 01:27:37.495428 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO dbcounter [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Registered counter for database nova_cell0 Sep 26 01:27:37.501901 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG oslo_db.sqlalchemy.engines [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.505976 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:27:37.506583 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writer thread running {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.510374 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writer thread running {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:27:37.846981 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: WARNING keystonemiddleware.auth_token [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:27:37.848039 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: WARNING keystonemiddleware.auth_token [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:27:37.854298 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: WARNING keystonemiddleware.auth_token [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:27:37.855378 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: WARNING keystonemiddleware.auth_token [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:27:38.197304 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: WARNING keystonemiddleware.auth_token [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:27:38.198071 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: WARNING keystonemiddleware.auth_token [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:27:38.203222 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: WARNING keystonemiddleware.auth_token [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:27:38.204407 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: WARNING keystonemiddleware.auth_token [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:27:38.209377 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bc90699c0 pid: 105621 (default app) Sep 26 01:27:38.209678 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bc90699c0 pid: 105622 (default app) Sep 26 01:27:38.211439 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:27:38.212690 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-0908a699-9fc7-479d-9b4e-994ea0293818 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Sep 26 01:27:38.213063 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Mon Sep 26 01:27:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:00.046857 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:00.048708 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002581 Sep 26 01:29:00.056451 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:00.063741 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_api:SELECT=3 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.068141 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_cell0:SELECT=3 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.069071 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_cell1:SELECT=3 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.071991 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:00.972085 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-473a6b56-5d81-4873-b545-b4a19810828c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:01.004253 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-473a6b56-5d81-4873-b545-b4a19810828c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.948164 Sep 26 01:29:01.005222 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Sep 26 01:29:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:03.649513 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:03.650550 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-8ecabd6a-e32e-4841-b4bb-07c8c5199edb None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 26 01:29:03.651106 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:04.118269 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-eb4f3666-a247-44b4-9b2e-6e3c87d9cc1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:04.167194 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-eb4f3666-a247-44b4-9b2e-6e3c87d9cc1e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510046 Sep 26 01:29:04.167769 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:04.182066 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_api:SELECT=3 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.183618 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_cell0:SELECT=3 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.185603 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_cell1:SELECT=3 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.186341 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:04.396843 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-bbe3b561-6a1d-4c1e-9e39-812bd09597af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:04.465791 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-bbe3b561-6a1d-4c1e-9e39-812bd09597af admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289657 Sep 26 01:29:04.466689 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Sep 26 01:29:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:07.102525 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-eb4f3666-a247-44b4-9b2e-6e3c87d9cc1e admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:07.104135 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-eb4f3666-a247-44b4-9b2e-6e3c87d9cc1e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002819 Sep 26 01:29:07.104741 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:07.767538 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-0ad4714d-119e-4535-8b12-dadf75f31a8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:07.808684 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-0ad4714d-119e-4535-8b12-dadf75f31a8c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697770 Sep 26 01:29:07.817807 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:07.825659 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-12217420-fccc-4dd4-9d00-92ba07a1a65c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:07.869675 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-12217420-fccc-4dd4-9d00-92ba07a1a65c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049963 Sep 26 01:29:07.870405 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Sep 26 01:29:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:10.510405 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-0ad4714d-119e-4535-8b12-dadf75f31a8c admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:10.511448 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-0ad4714d-119e-4535-8b12-dadf75f31a8c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 26 01:29:10.511847 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:10.933716 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-5dd6e25b-17a3-4ecd-98ab-227bf8a9254e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:10.954056 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-5dd6e25b-17a3-4ecd-98ab-227bf8a9254e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435452 Sep 26 01:29:10.954720 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:10.966753 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-bd94daa9-e839-46f3-b162-e2a8b4520058 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:10.994907 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-bd94daa9-e839-46f3-b162-e2a8b4520058 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031855 Sep 26 01:29:10.995503 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Sep 26 01:29:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:29:13.650470 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-5dd6e25b-17a3-4ecd-98ab-227bf8a9254e admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:13.651394 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-5dd6e25b-17a3-4ecd-98ab-227bf8a9254e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 26 01:29:13.651804 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:14.214311 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-947bc820-8008-4bba-82bb-9bdac85dce25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:14.233879 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-947bc820-8008-4bba-82bb-9bdac85dce25 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.576058 Sep 26 01:29:14.234693 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:14.247386 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-ddbb9e2b-e749-418c-911c-4e465f24145d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:14.276298 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-ddbb9e2b-e749-418c-911c-4e465f24145d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032651 Sep 26 01:29:14.276958 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Sep 26 01:29:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:16.972197 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-947bc820-8008-4bba-82bb-9bdac85dce25 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:16.973278 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-947bc820-8008-4bba-82bb-9bdac85dce25 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 26 01:29:16.973677 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:17.403185 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:17.424601 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444227 Sep 26 01:29:17.425435 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:17.437805 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-54900ea7-f0d8-4937-979e-519d0b4066f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:17.463888 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-54900ea7-f0d8-4937-979e-519d0b4066f8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029738 Sep 26 01:29:17.464500 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Mon Sep 26 01:29:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:20.192374 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:20.193275 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 26 01:29:20.193684 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:20.633733 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-5b552495-e5a7-4f47-b070-20fe10b6d88d admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:20.661703 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-5b552495-e5a7-4f47-b070-20fe10b6d88d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461371 Sep 26 01:29:20.662358 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Sep 26 01:29:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:29:24.013856 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:24.014867 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-089a86ff-ace8-44ad-8e1e-639829394e8e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 26 01:29:24.015272 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:29:24.478802 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-a3c1a79c-53c1-4cfd-bcdb-fdf440f1f501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:24.502858 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-a3c1a79c-53c1-4cfd-bcdb-fdf440f1f501 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481049 Sep 26 01:29:24.503540 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:24.517084 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-df6ff0fd-61c7-41c6-b219-2eb59a0d5550 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:24.545209 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-df6ff0fd-61c7-41c6-b219-2eb59a0d5550 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032245 Sep 26 01:29:24.545800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Sep 26 01:29:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:29:27.141673 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-a3c1a79c-53c1-4cfd-bcdb-fdf440f1f501 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:27.142678 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-a3c1a79c-53c1-4cfd-bcdb-fdf440f1f501 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 26 01:29:27.143074 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:27.517374 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-aa6544e6-5b13-4aa8-9a20-5bc9ec421d0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:27.537859 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-aa6544e6-5b13-4aa8-9a20-5bc9ec421d0f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.388657 Sep 26 01:29:27.538579 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:27.550578 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-2bebdb0d-d30c-4785-b44d-8cc45940f72f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:27.575911 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-2bebdb0d-d30c-4785-b44d-8cc45940f72f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029022 Sep 26 01:29:27.577588 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Sep 26 01:29:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:30.209071 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-aa6544e6-5b13-4aa8-9a20-5bc9ec421d0f admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:30.210110 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-aa6544e6-5b13-4aa8-9a20-5bc9ec421d0f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 26 01:29:30.210641 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:30.670899 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-29e720cb-68cf-4910-8641-392a6cb35030 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "disk": 40, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:30.692150 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-29e720cb-68cf-4910-8641-392a6cb35030 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.475468 Sep 26 01:29:30.693017 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:30.705798 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-a2b693fa-6f2f-4859-b39c-7e8d1370565d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:30.711216 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:30.738599 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-a2b693fa-6f2f-4859-b39c-7e8d1370565d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036860 Sep 26 01:29:30.739183 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Sep 26 01:29:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:33.384816 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-29e720cb-68cf-4910-8641-392a6cb35030 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:33.386613 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-29e720cb-68cf-4910-8641-392a6cb35030 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002294 Sep 26 01:29:33.404443 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:29:33.886627 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0e3977d-6150-40ad-89db-35cab7e2182e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:33.911005 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0e3977d-6150-40ad-89db-35cab7e2182e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.517026 Sep 26 01:29:33.911669 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:29:33.924794 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-76bcc853-75cc-4dee-a038-cf21ef100d37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:33.949419 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-76bcc853-75cc-4dee-a038-cf21ef100d37 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028355 Sep 26 01:29:33.949995 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Sep 26 01:29:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:29:36.560640 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0e3977d-6150-40ad-89db-35cab7e2182e admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:36.561656 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0e3977d-6150-40ad-89db-35cab7e2182e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 26 01:29:36.562057 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:37.006657 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:37.014390 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:37.030857 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462721 Sep 26 01:29:37.031816 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Mon Sep 26 01:29:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:29:37.050177 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-365e878c-3bd8-4c1f-845e-f28f0b96fdaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:29:37.075621 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-365e878c-3bd8-4c1f-845e-f28f0b96fdaf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034328 Sep 26 01:29:37.076221 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Mon Sep 26 01:29:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:29:55.665564 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:55.666520 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 26 01:29:55.666918 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:29:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:55.677598 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:29:56.060963 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-444b4e7c-41dc-42aa-a262-0d64948a9ae2 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:56.079777 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-444b4e7c-41dc-42aa-a262-0d64948a9ae2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406603 Sep 26 01:29:56.080312 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Sep 26 01:29:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:29:57.391700 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:57.392738 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-f72cc823-d587-4dcc-9728-4920cd6cdc57 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 26 01:29:57.393131 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:29:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:57.914859 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-e23cef8c-244b-4185-a376-71f6f16748d0 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:57.920185 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.wsgi [None req-e23cef8c-244b-4185-a376-71f6f16748d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-e23cef8c-244b-4185-a376-71f6f16748d0 admin admin] Request method failure captured: Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept: application/json Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept-Encoding: gzip, deflate Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Connection: keep-alive Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Content-Length: 0 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Host: 10.222.0.25 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-Api-Version: compute 2.92 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-System-Scope: None Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: User-Agent: python-novaclient Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Auth-Token: gAAAAABjMQCVDt2cdy-z0UTuvfgOdINy1iflbeChtuqu8VOQ_M2j7YpOgaP97wbdonekckCJC2XQ8yrioLlD9Qcdowv702eqRuaMdRAqwufYGTEYZxe4LPFG5w3UoVDp6tu1d6m-nt3al5r7W7qPF6dSf8IhEeQlRB-2eOq23aCNpTtJt66BArs Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Id: None Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Name: None Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Identity-Status: Confirmed Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Is-Admin-Project: True Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Id: default Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Name: Default Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Name: admin Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Role: admin,member,reader Sep 26 01:29:57.923465 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Roles: admin,member,reader Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant: admin Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Name: admin Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User: admin Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Id: default Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Name: Default Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Name: admin Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: method: > Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: exception: Flavor 42 could not be found. Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: action_args: {'id': '42'} Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:29:57.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:57.925800 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:57.926938 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-e23cef8c-244b-4185-a376-71f6f16748d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:29:57.928570 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-e23cef8c-244b-4185-a376-71f6f16748d0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394323 Sep 26 01:29:57.928570 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Sep 26 01:29:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:57.935511 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-2179b046-e461-441f-91e0-1043c0c332f2 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:57.959318 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-2179b046-e461-441f-91e0-1043c0c332f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027624 Sep 26 01:29:57.960156 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:29:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:29:57.970823 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-737ba680-8847-414b-9e48-4bedcf879523 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:57.996534 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-737ba680-8847-414b-9e48-4bedcf879523 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030127 Sep 26 01:29:57.997087 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:29:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:29:58.007515 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-b2d6ff83-929c-4457-ad33-e834ee572099 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:58.013163 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.wsgi [None req-b2d6ff83-929c-4457-ad33-e834ee572099 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-b2d6ff83-929c-4457-ad33-e834ee572099 admin admin] Request method failure captured: Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept: application/json Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept-Encoding: gzip, deflate Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Connection: keep-alive Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Content-Length: 0 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Host: 10.222.0.25 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-Api-Version: compute 2.92 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-System-Scope: None Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: User-Agent: python-novaclient Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Auth-Token: gAAAAABjMQCVDt2cdy-z0UTuvfgOdINy1iflbeChtuqu8VOQ_M2j7YpOgaP97wbdonekckCJC2XQ8yrioLlD9Qcdowv702eqRuaMdRAqwufYGTEYZxe4LPFG5w3UoVDp6tu1d6m-nt3al5r7W7qPF6dSf8IhEeQlRB-2eOq23aCNpTtJt66BArs Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Id: None Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Name: None Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Identity-Status: Confirmed Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Is-Admin-Project: True Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Id: default Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Name: Default Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Name: admin Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Role: admin,member,reader Sep 26 01:29:58.016745 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Roles: admin,member,reader Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant: admin Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Name: admin Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User: admin Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Id: default Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Name: Default Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Name: admin Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: method: > Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: exception: Flavor 42 could not be found. Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: action_args: {'id': '42'} Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:29:58.018250 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:58.019138 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:58.020155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-b2d6ff83-929c-4457-ad33-e834ee572099 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:29:58.021182 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-b2d6ff83-929c-4457-ad33-e834ee572099 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015008 Sep 26 01:29:58.021182 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Sep 26 01:29:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 26 01:29:59.235274 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-737ba680-8847-414b-9e48-4bedcf879523 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:59.236278 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-737ba680-8847-414b-9e48-4bedcf879523 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 26 01:29:59.236703 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:29:59.757769 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-2ba3fde1-980c-404e-92af-443007760746 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:59.762768 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.wsgi [None req-2ba3fde1-980c-404e-92af-443007760746 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-2ba3fde1-980c-404e-92af-443007760746 admin admin] Request method failure captured: Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept: application/json Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept-Encoding: gzip, deflate Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Connection: keep-alive Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Content-Length: 0 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Host: 10.222.0.25 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-Api-Version: compute 2.92 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-System-Scope: None Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: User-Agent: python-novaclient Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Auth-Token: gAAAAABjMQCXYzK8s6pNsy65MJz06ypS-2buFvPTqISugB5Bzo_r4yHHc_79QxaF7BCVqmNmgxbHXZoqK-49vJoc-9YIlBC7bU4fJUZrgJ1BqydnCQijzT6EE42UIlPhmA9PavUFgEI-f0hJQyMl_lJKC2I74YJ0weln1-v9VkA9qchWBuv-jww Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Id: None Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Name: None Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Identity-Status: Confirmed Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Is-Admin-Project: True Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Id: default Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Name: Default Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Name: admin Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Role: admin,member,reader Sep 26 01:29:59.764252 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Roles: admin,member,reader Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant: admin Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Name: admin Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User: admin Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Id: default Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Name: Default Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Name: admin Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: method: > Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: exception: Flavor 84 could not be found. Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: action_args: {'id': '84'} Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:29:59.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:59.766850 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.768455 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-2ba3fde1-980c-404e-92af-443007760746 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:29:59.769799 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-2ba3fde1-980c-404e-92af-443007760746 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390524 Sep 26 01:29:59.769799 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Sep 26 01:29:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 01:29:59.776232 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-0c837ca5-d9b1-4a96-879f-cdcb3429ee9d admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:59.791487 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-0c837ca5-d9b1-4a96-879f-cdcb3429ee9d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019610 Sep 26 01:29:59.792030 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:29:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:29:59.801508 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-b01399c7-f5c4-4140-9c36-3751df04b1de admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:59.817348 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-b01399c7-f5c4-4140-9c36-3751df04b1de admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019344 Sep 26 01:29:59.817887 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:29:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:29:59.828470 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-0a334bdd-5d5d-4b5f-9a87-f48c73050db8 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:29:59.833678 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.wsgi [None req-0a334bdd-5d5d-4b5f-9a87-f48c73050db8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-0a334bdd-5d5d-4b5f-9a87-f48c73050db8 admin admin] Request method failure captured: Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept: application/json Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept-Encoding: gzip, deflate Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Connection: keep-alive Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Content-Length: 0 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Host: 10.222.0.25 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-Api-Version: compute 2.92 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-System-Scope: None Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: User-Agent: python-novaclient Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Auth-Token: gAAAAABjMQCXYzK8s6pNsy65MJz06ypS-2buFvPTqISugB5Bzo_r4yHHc_79QxaF7BCVqmNmgxbHXZoqK-49vJoc-9YIlBC7bU4fJUZrgJ1BqydnCQijzT6EE42UIlPhmA9PavUFgEI-f0hJQyMl_lJKC2I74YJ0weln1-v9VkA9qchWBuv-jww Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Id: None Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Name: None Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Identity-Status: Confirmed Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Is-Admin-Project: True Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Id: default Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Name: Default Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Name: admin Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Role: admin,member,reader Sep 26 01:29:59.836211 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Roles: admin,member,reader Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant: admin Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Name: admin Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User: admin Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Id: default Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Name: Default Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Name: admin Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: method: > Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: exception: Flavor 84 could not be found. Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: action_args: {'id': '84'} Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:29:59.837842 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:59.838810 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:29:59.840188 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-0a334bdd-5d5d-4b5f-9a87-f48c73050db8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:29:59.841469 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-0a334bdd-5d5d-4b5f-9a87-f48c73050db8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013176 Sep 26 01:29:59.841776 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Mon Sep 26 01:29:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:01.061598 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-b01399c7-f5c4-4140-9c36-3751df04b1de admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:01.062687 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-b01399c7-f5c4-4140-9c36-3751df04b1de admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 26 01:30:01.063074 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:01.589023 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-402f41c8-2c99-4f93-a0fc-edcf4d2998b0 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:01.594778 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.wsgi [None req-402f41c8-2c99-4f93-a0fc-edcf4d2998b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-402f41c8-2c99-4f93-a0fc-edcf4d2998b0 admin admin] Request method failure captured: Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept: application/json Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Accept-Encoding: gzip, deflate Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Connection: keep-alive Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Content-Length: 0 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Host: 10.222.0.25 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-Api-Version: compute 2.92 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Openstack-System-Scope: None Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: User-Agent: python-novaclient Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Auth-Token: gAAAAABjMQCYGizakLxS5xi-XYLOg28ki9RbCDIwHrxIssqDk29Knv4W9_hSK6MAldDwt3UJbm9-TO14RUC6QlN-n1kYi-A00zbsYPNb5QcNKMKHg4G8VFPkr0wmyXnTXSsjG-i8VoBaOnIjzpusPtduS8fl-Kd1QQJdrynC4XAgj_L2ovW_OIM Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Id: None Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Domain-Name: None Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Identity-Status: Confirmed Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Is-Admin-Project: True Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Id: default Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Domain-Name: Default Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Project-Name: admin Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Role: admin,member,reader Sep 26 01:30:01.596260 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Roles: admin,member,reader Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant: admin Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-Tenant-Name: admin Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User: admin Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Id: default Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Domain-Name: Default Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: X-User-Name: admin Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: method: > Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: exception: Flavor 451 could not be found. Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: action_args: {'id': '451'} Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:30:01.597827 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:30:01.598818 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.600959 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-402f41c8-2c99-4f93-a0fc-edcf4d2998b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:30:01.602233 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-402f41c8-2c99-4f93-a0fc-edcf4d2998b0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394363 Sep 26 01:30:01.602233 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:30:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:01.608069 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-fadadc72-0309-4c85-90a2-004ac8961d5a admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:01.623018 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-fadadc72-0309-4c85-90a2-004ac8961d5a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018555 Sep 26 01:30:01.623530 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:30:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:30:01.632861 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:01.648044 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018833 Sep 26 01:30:01.648602 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Mon Sep 26 01:30:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:30:01.657674 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-778b0964-688e-40dc-9eea-7108fa8cbc9a admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:01.663230 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.wsgi [None req-778b0964-688e-40dc-9eea-7108fa8cbc9a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-778b0964-688e-40dc-9eea-7108fa8cbc9a admin admin] Request method failure captured: Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept: application/json Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Accept-Encoding: gzip, deflate Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Connection: keep-alive Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Content-Length: 0 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Host: 10.222.0.25 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-Api-Version: compute 2.92 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Openstack-System-Scope: None Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: User-Agent: python-novaclient Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Auth-Token: gAAAAABjMQCYGizakLxS5xi-XYLOg28ki9RbCDIwHrxIssqDk29Knv4W9_hSK6MAldDwt3UJbm9-TO14RUC6QlN-n1kYi-A00zbsYPNb5QcNKMKHg4G8VFPkr0wmyXnTXSsjG-i8VoBaOnIjzpusPtduS8fl-Kd1QQJdrynC4XAgj_L2ovW_OIM Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Id: None Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Domain-Name: None Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Identity-Status: Confirmed Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Is-Admin-Project: True Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Id: default Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Domain-Name: Default Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Project-Name: admin Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Role: admin,member,reader Sep 26 01:30:01.664747 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Roles: admin,member,reader Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7124d36dd410484faf5f0034e732bac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7124d36dd410484faf5f0034e732bac5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant: admin Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Id: 7124d36dd410484faf5f0034e732bac5 Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-Tenant-Name: admin Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User: admin Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Id: default Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Domain-Name: Default Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Id: d47510704d9d4183ab8e8ff6578a4a83 Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: X-User-Name: admin Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: method: > Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: exception: Flavor 451 could not be found. Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: action_args: {'id': '451'} Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:30:01.666332 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:30:01.667364 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: ERROR nova.api.openstack.wsgi Sep 26 01:30:01.668863 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-778b0964-688e-40dc-9eea-7108fa8cbc9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:30:01.670146 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-778b0964-688e-40dc-9eea-7108fa8cbc9a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011904 Sep 26 01:30:01.670146 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:30:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 01:30:02.892981 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:02.893980 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 26 01:30:02.894366 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:03.414259 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-571a36cc-7bab-484c-8e82-4c073a6c831d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:30:03.433261 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-571a36cc-7bab-484c-8e82-4c073a6c831d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401320 Sep 26 01:30:03.433793 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Sep 26 01:30:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:30:04.662655 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:04.663730 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 26 01:30:04.664126 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:05.184542 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-6742426f-fde9-4a32-a2fe-25c15c2850e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:30:05.203237 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-6742426f-fde9-4a32-a2fe-25c15c2850e4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401000 Sep 26 01:30:05.203773 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Sep 26 01:30:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:30:06.428951 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:06.429953 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Sep 26 01:30:06.430349 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:06.949976 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-ad665d62-5c0f-4884-9fe6-5b9651cd4719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:30:06.968378 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-ad665d62-5c0f-4884-9fe6-5b9651cd4719 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400845 Sep 26 01:30:06.968907 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Sep 26 01:30:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:30:08.199797 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:08.200814 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 26 01:30:08.201206 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:08.723434 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-1cd23819-5273-44f1-a903-6e480b5fb0f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:30:08.741372 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-1cd23819-5273-44f1-a903-6e480b5fb0f0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401235 Sep 26 01:30:08.741915 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Mon Sep 26 01:30:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:30:09.968651 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:09.969674 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 26 01:30:09.970092 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:30:10.490835 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-66f94356-f296-4875-bb25-8044474782ab admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:30:10.511792 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-66f94356-f296-4875-bb25-8044474782ab admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405034 Sep 26 01:30:10.512331 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Mon Sep 26 01:30:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:31:07.643259 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:07.644184 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-f0167537-83aa-4022-8130-e472dcd54a63 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 26 01:31:07.644626 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Mon Sep 26 01:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:31:07.655312 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:08.034668 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-1aa80363-ff81-43c1-9a1d-81dc2f4b3676 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:08.056394 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-1aa80363-ff81-43c1-9a1d-81dc2f4b3676 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405442 Sep 26 01:31:08.056941 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Mon Sep 26 01:31:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:31:08.077811 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_api:SELECT=14 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:31:08.081517 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-aa52ff19-aeb0-40af-9cad-dc72a1af1bc1 admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:08.089058 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-aa52ff19-aeb0-40af-9cad-dc72a1af1bc1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012946 Sep 26 01:31:08.089566 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Mon Sep 26 01:31:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:31:08.101468 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-98d1b10e-fdd0-4c3d-9eed-33f269daa884 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:08.108700 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-98d1b10e-fdd0-4c3d-9eed-33f269daa884 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011280 Sep 26 01:31:08.109213 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Mon Sep 26 01:31:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:31:08.121411 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:08.128470 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010561 Sep 26 01:31:08.128984 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Mon Sep 26 01:31:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:31:08.140071 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-9e4b1ac5-a181-4330-b192-5a724768044e admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:31:08.147701 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-9e4b1ac5-a181-4330-b192-5a724768044e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011068 Sep 26 01:31:08.148210 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Mon Sep 26 01:31:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:34:06.972659 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:06.973720 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 26 01:34:06.974057 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:34:07.115025 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_api:SELECT=6 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:07.276948 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:07.282223 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:07.282714 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:07.283140 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:07.283886 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:07.284337 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:07.284783 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:07.316424 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-59c947d5-9119-47f5-a8a6-911a2db57362 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.202493 Sep 26 01:34:07.316897 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:34:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:34:08.404298 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:08.405319 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 26 01:34:08.405714 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:34:08.597015 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:08.600460 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:08.600937 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:08.601366 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:08.602081 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:08.602526 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:08.602946 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:08.622425 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-0f8e9e93-e830-4763-ac3c-b3e3bc52ebe4 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077226 Sep 26 01:34:08.622881 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:34:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:34:20.118514 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:20.119524 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 26 01:34:20.119923 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:34:20.262217 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_cell0:SELECT=4 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:20.262934 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_cell1:SELECT=4 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:20.264071 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG dbcounter [-] [105622] Writing DB stats nova_api:SELECT=8 {{(pid=105622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:34:20.313033 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:20.316412 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:20.316896 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:20.317338 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:20.318068 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:20.318549 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:20.318975 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:20.345402 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-148ffebf-fcff-4c57-afb7-95d55e94ca01 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087576 Sep 26 01:34:20.345960 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:34:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:34:21.428208 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG nova.api.openstack.wsgi [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] Calling method '>' {{(pid=105621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:21.429247 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: INFO nova.api.openstack.requestlog [None req-14374119-405a-47fc-9413-ce6ed246d07c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 26 01:34:21.429644 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: [pid: 105621|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1074 bytes} [Mon Sep 26 01:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:34:21.619959 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG nova.api.openstack.wsgi [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Calling method '>' {{(pid=105622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:34:21.623531 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:21.623986 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:21.624440 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:21.625155 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:34:21.625599 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:34:21.626013 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: DEBUG oslo_concurrency.lockutils [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:34:21.647463 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: INFO nova.api.openstack.requestlog [None req-453ab104-00c1-427c-82ae-e3b2f3869ea6 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078998 Sep 26 01:34:21.647951 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: [pid: 105622|app: 0|req: 38/76] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Sep 26 01:34:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:35:21.056921 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: Mon Sep 26 01:35:21 2022 - graceful shutdown triggered... Sep 26 01:35:21.057395 dv-cinder-859203-2-iscsi devstack@n-api.service[105622]: Gracefully killing worker 2 (pid: 105622)... Sep 26 01:35:21.057771 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: Gracefully killing worker 1 (pid: 105621)... Sep 26 01:35:21.057577 dv-cinder-859203-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 01:35:21.183550 dv-cinder-859203-2-iscsi devstack@n-api.service[105621]: DEBUG dbcounter [-] [105621] Writing DB stats nova_api:SELECT=4 {{(pid=105621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:35:22.058075 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: worker 1 buried after 1 seconds Sep 26 01:35:22.058576 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: worker 2 buried after 1 seconds Sep 26 01:35:22.058576 dv-cinder-859203-2-iscsi devstack@n-api.service[105620]: goodbye to uWSGI. Sep 26 01:35:22.059769 dv-cinder-859203-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 01:35:22.060387 dv-cinder-859203-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 01:35:22.063649 dv-cinder-859203-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 01:35:22.081065 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 01:35:22 2022] *** Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: nodename: dv-cinder-859203-2-iscsi Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: machine: x86_64 Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: clock source: unix Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: pcre jit disabled Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: detected number of CPU cores: 4 Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: current working directory: / Sep 26 01:35:22.083450 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: detected binary path: /usr/bin/uwsgi-core Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: your processes number limit is 47680 Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: your memory page size is 4096 bytes Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: detected max file descriptor number: 2048 Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: lock engine: pthread robust mutexes Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: thunder lock: enabled Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 01:35:22.084334 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 01:35:22.126540 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: Python main interpreter initialized at 0x555766e899c0 Sep 26 01:35:22.126540 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: python threads support enabled Sep 26 01:35:22.126540 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: your server socket listen backlog is limited to 100 connections Sep 26 01:35:22.126540 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: your mercy for graceful operations on workers is 90 seconds Sep 26 01:35:22.127009 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 01:35:22.127009 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: *** Operational MODE: preforking *** Sep 26 01:35:22.127275 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: *** uWSGI is running in multiple interpreter mode *** Sep 26 01:35:22.127275 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: spawned uWSGI master process (pid: 127104) Sep 26 01:35:22.127485 dv-cinder-859203-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 01:35:22.128118 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: spawned uWSGI worker 1 (pid: 127125, cores: 1) Sep 26 01:35:22.128497 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: spawned uWSGI worker 2 (pid: 127126, cores: 1) Sep 26 01:35:22.128674 dv-cinder-859203-2-iscsi devstack@n-api.service[127104]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 01:35:22.799841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 01:35:22.813323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 01:35:23.963157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:35:23.963157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: from cryptography.utils import int_from_bytes Sep 26 01:35:23.963790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:35:23.963790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: from cryptography.utils import int_from_bytes Sep 26 01:35:23.994233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:35:23.994233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: from cryptography.utils import int_from_bytes Sep 26 01:35:23.994805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 01:35:23.994805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: from cryptography.utils import int_from_bytes Sep 26 01:35:26.452064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:35:26.452797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:35:26.452902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:35:26.453266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:35:26.453526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:35:26.453925 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.454263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.454595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.454922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.455257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.455575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.455910 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.456234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.456598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.456864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.457188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.457667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859203-2-iscsi {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.458003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.458327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.458648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.458978 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.459293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.459623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.459936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.460479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.460924 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.461242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.461569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.461917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.462236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.462557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.462885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.463216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.463540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.464528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.464916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859203-2-iscsi {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.465092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 01:35:26.465549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 01:35:26.465652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.465652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.465834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 01:35:26.465919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.466085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 01:35:26.466286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.466414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 01:35:26.466653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.466829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.466990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.467196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.467524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.467885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468515 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468613 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.468917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469718 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.469826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859203-2-iscsi {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.470801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471393 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.471962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.472897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.473147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.473291 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.473531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.473689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.473784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474024 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474291 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.474827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.475981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859203-2-iscsi {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.476946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477889 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.477992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.478975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.479183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.479284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.479521 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.479621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.479856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480488 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.480805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481654 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.481988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.482939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483141 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483240 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483460 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.483886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484367 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.484936 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485677 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.485961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.486874 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487369 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.487984 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488078 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488406 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488741 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.488940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489032 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489343 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.489973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490184 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.490910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491422 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491737 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.491842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492664 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.492771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493737 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.493989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494665 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.494893 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.495711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.495810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.495968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.496211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.496306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.496549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.496871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.497158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.497466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.497568 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.497773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.497941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.498080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.498374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.503882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.503882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.504968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505161 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.505969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506054 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.506490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.506672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.506847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.506939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.507024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.507198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.507421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.507627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.507847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.507983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.508055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508307 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.508397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508482 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.508563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.508720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.508855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.508932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.509011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.509095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.509174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.509722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.509831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.509914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.509995 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.510068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 01:35:26.510139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.510209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.510403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.510561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.511282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.511516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.511623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.511861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.512890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513182 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513554 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.513979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.514825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515143 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515451 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.515999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.516162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.516316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.516562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.516717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.516861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517714 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.517890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.518876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519338 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.519958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520737 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.520888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.521989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.522902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523492 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.523992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524296 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.524958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.525100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.525262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.525609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.525777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.525937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526529 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526683 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.526827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.527107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.527251 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.527402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.527699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.527859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.528949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529093 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529848 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.529992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.530929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531543 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.531881 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532703 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.532854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533302 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.533918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.534996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.535885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536529 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536683 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.536859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.537011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.537154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.537363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.537530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.537787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538166 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.538962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.539876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540195 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.540872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541030 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541182 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.541981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542160 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.542928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543086 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.543878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.544162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.544338 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.544526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.544678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.544837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.545942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546093 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.546887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547483 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.547948 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.548318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.548557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.548718 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.548869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.549960 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.550900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551206 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.551847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552673 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.552825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553643 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.553963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554113 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554476 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.554966 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.555910 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556059 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.556860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.557153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.557310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.557474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.558210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.558584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.558759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.558914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.559842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560507 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.560970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561772 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.561932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.562875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563182 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.563977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.564127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.564277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.564575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.564762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.564917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.565891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.566984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567751 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.567919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.568910 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.569854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570673 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.570971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571441 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571602 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.571910 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572240 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.572882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.573289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.573289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.574083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.574250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.574460 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.574629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.574829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.575245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.575245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.575550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.575712 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.575870 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576022 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.576987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.577942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578251 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578251 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.578873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.579970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.580142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.580383 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.580554 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.580721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.580881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581347 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.581993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.582144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.582303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.582454 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.582620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.582895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583387 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.583945 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.584107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.584267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.584524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.584702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.584864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585347 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585347 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.585972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.586899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587838 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.587989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.588139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.588299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.588474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.588627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.588819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.589961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590120 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590271 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.590884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591207 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591680 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.591848 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592159 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592497 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.592962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.593893 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594204 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594514 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.594885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595346 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.595985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596137 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596642 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.596956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.597894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598532 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.598842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599040 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.599811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600019 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600522 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.600879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601347 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.601988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602352 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.602964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.603726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604778 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.604947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605492 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.605944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606727 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.606884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.607967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.608952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609256 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609565 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.609884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610826 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.610983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611762 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.611919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.612070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.612221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.612221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.612580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.613380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.613556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.613711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.613873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614271 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.614958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615124 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615295 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.615907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.616873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617039 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617199 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.617988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.618917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619705 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.619857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.620611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.620854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.621867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622818 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622818 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.622818 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.623261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.623420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.623578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.623728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.623878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.624048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.624200 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.624461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.624704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.624990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.625229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.625491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.625766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.626019 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.626277 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.626528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.626785 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.626785 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.627303 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.627537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.627804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.628076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.628437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.628697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.628952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.629222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.629470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.629695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.629942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.630186 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.630474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.630640 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.630794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.630946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.631912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632566 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.632893 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633341 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633814 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.633973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.634970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.635143 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.635296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.635461 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.635621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.636454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.636619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.636783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.636935 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637409 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.637881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638347 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.638990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.639975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640900 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.640994 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641248 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641406 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641583 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.641979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642220 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.642937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643404 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.643946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644019 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644103 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.644996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645393 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.645767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.646221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.646395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.646548 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.646713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.646873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.647993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.648962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.649911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.650071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.652722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.652918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653090 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.653959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.654753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.655881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.656990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.657934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.658094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.658246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.658406 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.658586 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.658885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659059 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.659853 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.660918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.661916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662404 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662764 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662922 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.662922 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663522 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.663991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.664151 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.664314 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.664314 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.664709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.664867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665019 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665186 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.665855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666657 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.666817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.667786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.668860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669027 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.669961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670434 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.670921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671705 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.671858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.672981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.673919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.674896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.675873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.676175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.676372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.676545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.676706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.676857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677814 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.677965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.678923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679543 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.679862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.680844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681312 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681472 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.681625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.682128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.682283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.682283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.683274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.683438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.683598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.683752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.683912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.684915 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685751 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.685913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686388 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686705 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.686859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687347 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.687961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688113 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.688916 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689069 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689069 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689525 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689676 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.689840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.690936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691239 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.691873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.692851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.693943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.694690 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.694852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695839 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.695992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696638 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.696940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697268 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697570 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.697884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.698117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.698874 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.699121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.699427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.699596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.699596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.699596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.700354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.700517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.700679 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.700899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.701886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.702632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.702806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.702969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703434 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703434 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.703898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.704882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.705889 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.706996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707480 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.707943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.708989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.709988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.710965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.711970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.712771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.713135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.713241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.713519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.713612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.714432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.714598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.714815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.714941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715618 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715721 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.715968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716646 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.716959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717375 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717583 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.717912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718334 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718638 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.718961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.719911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720268 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.720920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.721824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722650 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.722959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.723993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.724964 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725275 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725604 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725831 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.725915 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726268 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.726902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.727130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.727226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.727436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.727533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.727679 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:35:26.727773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.728081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.728441 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.728766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.729113 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.729490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.730310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.730639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.730990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.731288 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.731610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.731951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.732289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.732738 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.733091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.733468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.733801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.734130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.734453 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.734795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.735119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.735440 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.735761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.736082 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.736427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.736758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.737089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.737400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.737726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.738051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.738385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.738722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.739038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.739374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.739712 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.740072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.740457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.740822 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.741160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.741484 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.741806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.742121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 01:35:26.742373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 01:35:26.790285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO dbcounter [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Registered counter for database nova_api Sep 26 01:35:26.804716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO dbcounter [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Registered counter for database nova_api Sep 26 01:35:26.811658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.818373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:26.826372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_db.sqlalchemy.engines [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.832990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writer thread running {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:26.875277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.context [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12c9fd8-f951-4e80-91ce-c97b9492891c(cell1) {{(pid=127125) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 01:35:26.879349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:35:26.879827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:35:26.881415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:35:26.882149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:35:26.882606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:35:26.884616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:35:26.887372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO dbcounter [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Registered counter for database nova_cell0 Sep 26 01:35:26.890904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.context [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12c9fd8-f951-4e80-91ce-c97b9492891c(cell1) {{(pid=127126) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 01:35:26.891564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO dbcounter [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Registered counter for database nova_cell1 Sep 26 01:35:26.894939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:35:26.895424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:35:26.897059 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:35:26.897826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:35:26.898287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:35:26.900267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.900417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:35:26.901761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.902614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO dbcounter [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Registered counter for database nova_cell0 Sep 26 01:35:26.906711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO dbcounter [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Registered counter for database nova_cell1 Sep 26 01:35:26.908378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:26.914407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_db.sqlalchemy.engines [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.916122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_db.sqlalchemy.engines [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:26.922689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writer thread running {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:26.924806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writer thread running {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:27.053202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:27.064215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO dbcounter [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Registered counter for database nova_cell0 Sep 26 01:35:27.070920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:27.072755 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO dbcounter [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Registered counter for database nova_cell0 Sep 26 01:35:27.075870 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:27.080046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_db.sqlalchemy.engines [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 01:35:27.084487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writer thread running {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 01:35:27.406438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:35:27.408267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: WARNING keystonemiddleware.auth_token [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:35:27.413624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:35:27.415572 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: WARNING keystonemiddleware.auth_token [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:35:27.769567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:35:27.771318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: WARNING keystonemiddleware.auth_token [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 01:35:27.776857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-a48fdf32-9ff7-4e62-bb7f-11d7d468d0b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:35:27.778429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: WARNING keystonemiddleware.auth_token [None req-70dca60a-2c69-4034-bbca-dc91b1a020cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 01:35:27.782442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555766e899c0 pid: 127125 (default app) Sep 26 01:35:27.783706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555766e899c0 pid: 127126 (default app) Sep 26 01:36:01.899245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:01.900102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:01.901867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:01.902991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:02.596311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f9e4402-2479-4a98-9d4a-5a47d05371b2 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Action: 'create', calling method: .version_select at 0x7f29d4822430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-164514332"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:03.975930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f9e4402-2479-4a98-9d4a-5a47d05371b2 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.088598 Sep 26 01:36:03.976755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Mon Sep 26 01:36:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2091 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 01:36:04.214314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d6b80d2-a127-4389-976e-b9b69af9859d tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d48cff70>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:04.242132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:04.242966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:04.244173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:04.245963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:05.475795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0d6b80d2-a127-4389-976e-b9b69af9859d tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 200 len: 345 microversion: 2.1 time: 1.486858 Sep 26 01:36:05.476383 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:36:03 2022] GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 345 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:05.494811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9b4dd64-03c6-4aaf-bcd5-622a789a572b tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Action: 'create', calling method: .version_select at 0x7f29d46f6280>, body: {"snapshot": {"volume_id": "c8c733e5-8b2f-4890-83d3-35af52697ba5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-340030980"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:06.106786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9b4dd64-03c6-4aaf-bcd5-622a789a572b tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.615241 Sep 26 01:36:06.118713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1162 bytes} [Mon Sep 26 01:36:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:06.121615 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ec78e2b2-fa37-4327-92db-804bf0d6c09c tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46cf3a0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:06.305848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ec78e2b2-fa37-4327-92db-804bf0d6c09c tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 286 microversion: 2.1 time: 0.189946 Sep 26 01:36:06.306592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:06 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:36:06.318603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6244ea0-da71-43bc-9b9d-3ec636fedde7 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d4688550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:06.437455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6244ea0-da71-43bc-9b9d-3ec636fedde7 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.122458 Sep 26 01:36:06.438417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Sep 26 01:36:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:06.455624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-59a05952-33f0-47da-8bde-d4bf0b24dd4c tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46cf430>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:06.564127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-59a05952-33f0-47da-8bde-d4bf0b24dd4c tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 286 microversion: 2.1 time: 0.118327 Sep 26 01:36:06.565424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:06 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:07.588942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65411b52-bd7f-4db5-9c00-744aadb37362 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d4688ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:07.668370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65411b52-bd7f-4db5-9c00-744aadb37362 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 286 microversion: 2.1 time: 0.091602 Sep 26 01:36:07.668987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:07 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:08.680886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-87122a7d-59eb-46fc-9a1e-a18590deda78 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46cfb80>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:08.737388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-87122a7d-59eb-46fc-9a1e-a18590deda78 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 286 microversion: 2.1 time: 0.060159 Sep 26 01:36:08.737968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:08 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:09.762159 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbd742bc-7e9d-4ce7-a3e9-d4ca5c6e8fbd tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d4688310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:09.818607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbd742bc-7e9d-4ce7-a3e9-d4ca5c6e8fbd tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 287 microversion: 2.1 time: 0.068093 Sep 26 01:36:09.821583 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:09 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:09.834259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9e1a0d06-0d34-4ec3-aad0-adb885596517 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46f2280>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:10.027528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9e1a0d06-0d34-4ec3-aad0-adb885596517 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 202 len: 0 microversion: 2.1 time: 0.197165 Sep 26 01:36:10.028263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Sep 26 01:36:09 2022] DELETE /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:36:10.055167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9ece3c4-666e-441a-b62b-c0d7b40ed252 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46f6ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:10.118263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9ece3c4-666e-441a-b62b-c0d7b40ed252 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 200 len: 286 microversion: 2.1 time: 0.084471 Sep 26 01:36:10.120006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:10 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:11.133147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6df045c-bfb9-47ff-a0a9-481eb9fdb601 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46cfd30>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:11.279106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-e6df045c-bfb9-47ff-a0a9-481eb9fdb601 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] HTTP exception thrown: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6df045c-bfb9-47ff-a0a9-481eb9fdb601 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Request method failure captured: Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 HTTP/1.1 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIBRsrcX8_VccAIukjcf9Ow7RyDkXBxkQhJGKm2jJrwUkOAK2yakDBKnefKW4uRcoY-r1hiRYPvi-9B-0AzKj-VSzehWMmljOhwHzn0sIMwh6FzOKJGsGf-mTfW8oxho_GJid5NINbyDUZ0QPyEIs5VVrMlNwUdXHtxP0mQf66l5Q4 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:36:11.296823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7cff87a197d4ddfbaeb0ac3d6d87fa9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: b6f18267454a4d148dd701ecb1109aac Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'b16692ad-2d78-444a-ae8b-aa46fe8be9c7'} Sep 26 01:36:11.298479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. (HTTP 404) (Request-ID: req-e376b403-5489-4025-a7d6-6f7c1da7bac1) Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.299242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:11.300148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 01:36:11.301280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. Sep 26 01:36:11.302477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:11.303260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6df045c-bfb9-47ff-a0a9-481eb9fdb601 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Returning 404 to user: Snapshot b16692ad-2d78-444a-ae8b-aa46fe8be9c7 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:36:11.304219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e6df045c-bfb9-47ff-a0a9-481eb9fdb601 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7" status: 404 len: 111 microversion: 2.1 time: 0.177006 Sep 26 01:36:11.304914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Sep 26 01:36:11 2022] GET /compute/v2.1/os-snapshots/b16692ad-2d78-444a-ae8b-aa46fe8be9c7 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:36:11.314155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a08b3a4e-e0a0-46d3-aad3-a0b20b484f12 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d4688280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:11.490872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a08b3a4e-e0a0-46d3-aad3-a0b20b484f12 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 202 len: 0 microversion: 2.1 time: 0.180606 Sep 26 01:36:11.491447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:36:11 2022] DELETE /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:36:11.504128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-673e98ef-005c-4da7-81ca-01cf9138e7de tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d504faf0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:11.622237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-673e98ef-005c-4da7-81ca-01cf9138e7de tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 200 len: 344 microversion: 2.1 time: 0.124914 Sep 26 01:36:11.623096 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:36:11 2022] GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:12.638073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06232867-88ec-4ee1-a12b-7893278a4d42 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d4688d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:13.003420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-06232867-88ec-4ee1-a12b-7893278a4d42 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] HTTP exception thrown: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06232867-88ec-4ee1-a12b-7893278a4d42 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Request method failure captured: Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 HTTP/1.1 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIBRsrcX8_VccAIukjcf9Ow7RyDkXBxkQhJGKm2jJrwUkOAK2yakDBKnefKW4uRcoY-r1hiRYPvi-9B-0AzKj-VSzehWMmljOhwHzn0sIMwh6FzOKJGsGf-mTfW8oxho_GJid5NINbyDUZ0QPyEIs5VVrMlNwUdXHtxP0mQf66l5Q4 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:36:13.007777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7cff87a197d4ddfbaeb0ac3d6d87fa9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: b6f18267454a4d148dd701ecb1109aac Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c8c733e5-8b2f-4890-83d3-35af52697ba5'} Sep 26 01:36:13.008850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. (HTTP 404) (Request-ID: req-328b2c73-ba38-476f-9ebc-0edddb31bc0e) Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.009633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:13.011011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 01:36:13.017198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06232867-88ec-4ee1-a12b-7893278a4d42 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Returning 404 to user: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06232867-88ec-4ee1-a12b-7893278a4d42 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 404 len: 109 microversion: 2.1 time: 0.375983 Sep 26 01:36:13.018134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:36:12 2022] GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 109 bytes in 377 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:36:13.024376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d0042d9-d15c-4c56-bd9d-7fdd62a58787 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46cfca0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:13.079266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-0d0042d9-d15c-4c56-bd9d-7fdd62a58787 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] HTTP exception thrown: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d0042d9-d15c-4c56-bd9d-7fdd62a58787 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Request method failure captured: Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: DELETE /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 HTTP/1.1 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIBRsrcX8_VccAIukjcf9Ow7RyDkXBxkQhJGKm2jJrwUkOAK2yakDBKnefKW4uRcoY-r1hiRYPvi-9B-0AzKj-VSzehWMmljOhwHzn0sIMwh6FzOKJGsGf-mTfW8oxho_GJid5NINbyDUZ0QPyEIs5VVrMlNwUdXHtxP0mQf66l5Q4 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:36:13.081835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7cff87a197d4ddfbaeb0ac3d6d87fa9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: b6f18267454a4d148dd701ecb1109aac Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'c8c733e5-8b2f-4890-83d3-35af52697ba5'} Sep 26 01:36:13.082930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. (HTTP 404) (Request-ID: req-92e5b7bd-bc11-4ddf-a190-add240382f96) Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.083707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:36:13.084780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 01:36:13.085759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.086851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.089312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d0042d9-d15c-4c56-bd9d-7fdd62a58787 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Returning 404 to user: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:36:13.090458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0d0042d9-d15c-4c56-bd9d-7fdd62a58787 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 404 len: 109 microversion: 2.1 time: 0.070012 Sep 26 01:36:13.091571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:36:13 2022] DELETE /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:36:13.099508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6ada713-7a02-4fc7-bdc7-7b8022613a53 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Calling method '.version_select at 0x7f29d46f63a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:13.164484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e6ada713-7a02-4fc7-bdc7-7b8022613a53 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] HTTP exception thrown: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6ada713-7a02-4fc7-bdc7-7b8022613a53 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Request method failure captured: Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 HTTP/1.1 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIBRsrcX8_VccAIukjcf9Ow7RyDkXBxkQhJGKm2jJrwUkOAK2yakDBKnefKW4uRcoY-r1hiRYPvi-9B-0AzKj-VSzehWMmljOhwHzn0sIMwh6FzOKJGsGf-mTfW8oxho_GJid5NINbyDUZ0QPyEIs5VVrMlNwUdXHtxP0mQf66l5Q4 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:36:13.166559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f7cff87a197d4ddfbaeb0ac3d6d87fa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f7cff87a197d4ddfbaeb0ac3d6d87fa9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: f7cff87a197d4ddfbaeb0ac3d6d87fa9 Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1123559640 Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: b6f18267454a4d148dd701ecb1109aac Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1123559640-project Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c8c733e5-8b2f-4890-83d3-35af52697ba5'} Sep 26 01:36:13.167909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. (HTTP 404) (Request-ID: req-4d44568c-54bc-45cf-968d-86e17210b8f2) Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.171719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:36:13.172815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 01:36:13.174230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6ada713-7a02-4fc7-bdc7-7b8022613a53 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] Returning 404 to user: Volume c8c733e5-8b2f-4890-83d3-35af52697ba5 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6ada713-7a02-4fc7-bdc7-7b8022613a53 tempest-VolumesSnapshotsTestJSON-1123559640 tempest-VolumesSnapshotsTestJSON-1123559640-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5" status: 404 len: 109 microversion: 2.1 time: 0.072548 Sep 26 01:36:13.176770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:36:13 2022] GET /compute/v2.1/os-volumes/c8c733e5-8b2f-4890-83d3-35af52697ba5 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:36:21.393396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1986297617", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "networks": [{"uuid": "a8e446b2-4420-4758-be48-be813b84eea5"}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:21.623807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] validate_networks() for [('a8e446b2-4420-4758-be48-be813b84eea5', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:36:22.975840 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b5baf7e-fb57-466e-92cb-ec9fa142efb0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: .version_select at 0x7f29d46f68b0>, body: {"keypair": {"name": "tempest-keypair-1572725688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBxFseIWyQqRYuANqatXDDMW5j0uGlzqHL8DqxcQ7ELwQYzCx29dDuYTQCLGDBop50vo6pKtXB5970VX1IeyP/K05qc26jlwgzugPDUAz0cTG5UbWMUpAatN/4iu8IjDg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:23.110767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-7b5baf7e-fb57-466e-92cb-ec9fa142efb0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:23.123026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-7b5baf7e-fb57-466e-92cb-ec9fa142efb0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for user bc62747b8aab40d9bff9d853b9b73199 and project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:23.219242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b5baf7e-fb57-466e-92cb-ec9fa142efb0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.870086 Sep 26 01:36:23.220204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 10/18] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Sep 26 01:36:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 872 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 26 01:36:23.805566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-587838615", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:24.080773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] validate_networks() for [('a09d4722-058c-40eb-9bf4-6c4a707b96c6', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:36:25.082445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:36:25.082984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:36:25.083388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:36:25.083987 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:36:25.084652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:36:25.109533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:25.110039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:25.110524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:25.111526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:25.112085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:25.112680 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:25.152933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Getting quotas for project 089c1c6e9cb94a19b451d0da50ba9bea. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:25.161193 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Getting quotas for user 73c365df91254de6a9217dab0280eff3 and project 089c1c6e9cb94a19b451d0da50ba9bea. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:25.177302 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:36:25.180556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:36:25.358886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-21fceafb-89c9-470d-86f8-1b92b62467ba tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.171033 Sep 26 01:36:25.361968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 9/19] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:36:25.889431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d9f3b39b-ecc1-4ac5-a2f7-57f4308a5631 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: .version_select at 0x7f29d4574670>, body: {"keypair": {"name": "tempest-keypair-1464159838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICCUnAPgubFDZu2gltmlg55mLJ5/CvioiwfWTHrn0MWjae2hoyvhNiICDRhD2SxLNN3mF3HuxXAD9wntDXcLt/AlBKRZbhTo6iPDcckGTcQY74ezmzo2jhD4eN39RlTBA=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:25.970120 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-d9f3b39b-ecc1-4ac5-a2f7-57f4308a5631 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for project 3677555d86804f03ae243765cfd3fd24. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:25.985051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-d9f3b39b-ecc1-4ac5-a2f7-57f4308a5631 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for user 06043e862a394764a58003f205cbb484 and project 3677555d86804f03ae243765cfd3fd24. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:26.104709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d9f3b39b-ecc1-4ac5-a2f7-57f4308a5631 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.736203 Sep 26 01:36:26.125666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:36:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:26.139659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ebf610d6-9ef9-4631-b2e3-758e61557906 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:26.149152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ebf610d6-9ef9-4631-b2e3-758e61557906 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:26.545777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ebf610d6-9ef9-4631-b2e3-758e61557906 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:26.604273 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ebf610d6-9ef9-4631-b2e3-758e61557906 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1215 microversion: 2.1 time: 0.477206 Sep 26 01:36:26.612780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:26 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1215 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:27.460337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:36:27.461604 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:36:27.463175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:36:27.463912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:36:27.464584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:36:27.504332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:27.505156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:27.505618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:27.506427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:27.508230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:27.510593 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:27.632993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:27.640604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b2a081f2-e638-4ba8-bb72-4083421e9536 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:27.641381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b2a081f2-e638-4ba8-bb72-4083421e9536 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:27.647065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for user fb54ba1355004e14b8dc43cf3c028e67 and project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:27.696977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:36:27.715134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:36:27.960830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c402ebcf-335a-40e3-8c42-651cf22693a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.739364 Sep 26 01:36:27.964547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 11/22] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:36:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:36:27.976861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f80a4ffb-93b2-40d2-bb9e-1024b83c4a7d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:27.979402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f80a4ffb-93b2-40d2-bb9e-1024b83c4a7d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:28.984527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b2a081f2-e638-4ba8-bb72-4083421e9536 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:29.015115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b2a081f2-e638-4ba8-bb72-4083421e9536 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1215 microversion: 2.1 time: 1.370851 Sep 26 01:36:29.020854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:27 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1215 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:29.150913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f80a4ffb-93b2-40d2-bb9e-1024b83c4a7d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:29.192115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f80a4ffb-93b2-40d2-bb9e-1024b83c4a7d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1221 microversion: 2.1 time: 1.214481 Sep 26 01:36:29.209611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:27 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1221 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:29.503549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870623250", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:29.602331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] validate_networks() for [('a09d4722-058c-40eb-9bf4-6c4a707b96c6', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:36:30.048860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:30.050100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:30.069549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:30.076109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:30.080729 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:30.084971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:30.091032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:30.093421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:30.713888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:30.736629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b22ba28c-2ba2-47c6-947a-0ec42c19bd6b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1267 microversion: 2.1 time: 0.691832 Sep 26 01:36:30.752408 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:30 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1267 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:30.759133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1516732637", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5af791d8-1618-4513-8e4d-eb7941c2c427"}], "security_groups": [{"name": "tempest-securitygroup--907607939"}], "key_name": "tempest-keypair-1572725688", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:31.341163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:36:31.343529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:36:31.345963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:36:31.348632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:36:31.349148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:36:31.359012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] validate_networks() for [('5af791d8-1618-4513-8e4d-eb7941c2c427', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:36:31.395480 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:31.396463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:31.397551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:31.398600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:31.419561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:31.423211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:31.514776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:31.537167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for user fb54ba1355004e14b8dc43cf3c028e67 and project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:31.581218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:36:31.584565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:36:31.672663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0ee849ae-0b7f-43bf-94f1-7e6f70f3fe85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.175064 Sep 26 01:36:31.674581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 13/26] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:36:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:36:31.681512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-241511038", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "698acfe8-54a1-4ab3-9d7d-022ce3847edf"}], "security_groups": [{"name": "tempest-securitygroup--322376784"}], "key_name": "tempest-keypair-1464159838", "user_data": "}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:32.510252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] validate_networks() for [('698acfe8-54a1-4ab3-9d7d-022ce3847edf', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:36:33.372041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:36:33.373077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:36:33.374080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:36:33.374695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:36:33.375424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:36:33.418951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:33.419470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:33.419927 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:33.429694 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:33.430774 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:33.431245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:33.525310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:33.541322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for user bc62747b8aab40d9bff9d853b9b73199 and project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:33.624822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:36:33.630745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:36:33.906607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d4ca349-fded-4682-a51b-c8447f2f2319 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.163977 Sep 26 01:36:33.939442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 14/27] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Sep 26 01:36:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3196 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 01:36:33.951736 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:33.981236 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:34.004953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.018321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.027984 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.042990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.046203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.049060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.545974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:34.555591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3cc5fb12-4d51-4d10-a08a-d910b5694da3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1274 microversion: 2.1 time: 0.611948 Sep 26 01:36:34.558432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:33 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1274 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:34.572853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:34.574924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:34.603632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.609134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.609592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.610340 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.610791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.611390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.703108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:36:34.704257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:36:34.704921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:36:34.705722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:36:34.706297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:36:34.747401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.748652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.749357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.750260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:34.750950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:34.751548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:34.788901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for project 3677555d86804f03ae243765cfd3fd24. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:36:34.802608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for user 06043e862a394764a58003f205cbb484 and project 3677555d86804f03ae243765cfd3fd24. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:36:34.829166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:36:34.833105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:36:34.999521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d25b82f5-7f20-4232-9fea-7d6cfec8f62f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.323608 Sep 26 01:36:35.003648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 14/29] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:36:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 3328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:36:35.022860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:35.023508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:35.041266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:35.042005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:35.042607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:35.045828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:35.046462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:35.047037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:35.339420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.363083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e579dca-dd00-45f5-897e-d26f3876689c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.803270 Sep 26 01:36:35.363632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:34 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:35.390929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.403138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0cb8c764-6a88-4fc0-aa12-84012ae51e4f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:35.403977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0cb8c764-6a88-4fc0-aa12-84012ae51e4f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:35.409988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.411450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.437413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d8abedee-c4c7-4ab2-b0c4-267b3dbc4f1b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1286 microversion: 2.20 time: 0.428364 Sep 26 01:36:35.438020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 15/31] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:35 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1286 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:35.598464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:35.599207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:35.624183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:35.624657 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:35.625115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:35.640037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:35.640695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:35.641207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:35.691072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0cb8c764-6a88-4fc0-aa12-84012ae51e4f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.700633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0cb8c764-6a88-4fc0-aa12-84012ae51e4f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1237 microversion: 2.1 time: 0.312880 Sep 26 01:36:35.705948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 17/32] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:35 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1237 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:35.806324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:35.813999 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e046765a-18b1-4ac6-b88c-48b67da6a2fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1274 microversion: 2.1 time: 0.228059 Sep 26 01:36:35.815332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 16/33] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:35 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:36.389027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:36.390128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:36.425745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.427884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.428678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.429637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.430991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.431921 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.472465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:36.473340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:36.489229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.494031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.495796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.497904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.498523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.501374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.657374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:36.669721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:36.682602 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:36.683769 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2de5e1ca-d867-4214-9652-2837bd36418c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1286 microversion: 2.20 time: 0.216506 Sep 26 01:36:36.684369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:36 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:36.732843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:36.734789 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:36.746985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.749546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.753033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.754321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:36.754880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:36.755918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:36.920025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:36.933799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-114cbab9-fbc5-45ff-ae99-d14493ff9891 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.549616 Sep 26 01:36:36.937050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:36 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:36.954706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:36.983794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:36.987847 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:36.999725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-dadffdfb-c187-42f0-b6b9-15763f817605 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1241 microversion: 2.1 time: 0.273120 Sep 26 01:36:37.005132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:36 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1241 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:37.030724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:37.035316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:37.035786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:37.038342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:37.041533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:37.042027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:37.189619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:37.199680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9aebf7a9-1b32-4ee1-bcb4-81b94120c1ab tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1274 microversion: 2.1 time: 0.260849 Sep 26 01:36:37.200276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 19/37] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:36 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:37.722724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:37.723682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:37.743933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:37.745420 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:37.745905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:37.746779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:37.747606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:37.748058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:37.969627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:37.970550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:37.989787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:37.994212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:37.996524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:37.999566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:38.000061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:38.007997 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:38.020808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:38.037494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:38.057816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:38.062951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1745f4f6-2781-4bfa-930e-91a15b75f715 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1278 microversion: 2.20 time: 0.351101 Sep 26 01:36:38.069879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 19/38] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:37 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:38.103016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:38.103812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:38.141439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:38.152095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:38.160743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:38.164771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:38.165272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:38.165716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:39.325447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:39.339969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e6e33357-75ed-4d8f-a6f1-28935992dff8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1233 microversion: 2.1 time: 1.265318 Sep 26 01:36:39.351147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:38 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1233 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:39.356241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:39.356902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:39.387102 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:39.395055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:39.395550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:39.396320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:39.396809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:39.397244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:39.629330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:39.647747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9d3fa229-9f6a-4abc-a308-83d8ef7a1fca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1280 microversion: 2.1 time: 0.295292 Sep 26 01:36:39.651103 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 21/40] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:39 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:39.669841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:39.673448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:39.689183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:39.689905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:39.690316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:39.691057 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:39.691516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:39.691948 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:39.700843 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:39.715574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1561c37-c4d2-4e30-abcc-469c4b77ee51 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 1.754258 Sep 26 01:36:39.720069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:37 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:40.367605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:40.368956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:40.385357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:40.391329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:40.394617 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:40.395204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:40.410115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:40.410804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:40.446841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:40.457330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:40.471311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:40.473191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6be08815-e8e9-4213-b63d-dfc30013277a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1334 microversion: 2.20 time: 0.817095 Sep 26 01:36:40.477312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:39 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1334 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:40.677451 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:40.678081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:40.687068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:40.687640 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:40.695174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:40.700312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:40.713429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:40.714403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:41.124879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:41.134358 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd4edc7b-e245-45ad-a22b-d2f6317a6b96 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1289 microversion: 2.1 time: 0.769218 Sep 26 01:36:41.134358 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:40 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1289 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:41.167144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:41.167768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:41.191555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:41.195279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:41.197146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:41.200070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:41.203952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:41.207419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:41.636424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:41.647512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d41caa3b-03df-4fe8-ad8d-0f134868e55e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.977574 Sep 26 01:36:41.649951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 23/44] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:40 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:41.910438 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6a0f6a-2168-483e-91c0-cbc3174cc2e0", "tag": "2225fa4c-2032-458b-bdb1-24d6a09e40c1"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:41.977469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:41.984977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:41.987613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.070598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Creating event network-changed:2225fa4c-2032-458b-bdb1-24d6a09e40c1 for instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 on hv-cinder-85920 Sep 26 01:36:42.071129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 01:36:42.071636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-74a2e39f-8d49-4c8e-8a00-fa251b4c415c req-5533d780-7f09-4d4b-a2df-df2cfe17679a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 01:36:42.093083 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.093651 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.094209 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.095062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.095526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.095982 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.163714 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.compute.rpcapi [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 01:36:42.164842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] Releasing lock "compute-rpcapi-router" {{(pid=127126) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 01:36:42.198069 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8c64375d-83a4-459e-9330-6226ae91f89b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544651 Sep 26 01:36:42.198937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 24/45] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:42.228316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:42.241763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:42.267074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.267573 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.270265 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.275614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.276527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.277254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.338381 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:42.347623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f420b757-e99b-4b61-92b1-c5e389c3ff6c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 1.200394 Sep 26 01:36:42.348255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 22/46] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:41 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:42.367793 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:42.370304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:42.397768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.399028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.399663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.401130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.408288 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.411636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.666326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:42.681324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:42.685192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:42.690478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e199c7a0-afb9-418c-875e-642933b1fbf1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1340 microversion: 2.20 time: 0.490106 Sep 26 01:36:42.697125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 25/47] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:42 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1340 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:42.702784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:42.713646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:42.729523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.738849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.739584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.740608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:42.745120 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:42.745869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:42.835158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:42.845921 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b797f486-c285-4dfc-a1e0-459fe5cc00a1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.495457 Sep 26 01:36:42.847558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:42 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:43.383983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:43.385397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:43.401230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:43.401971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:43.402595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:43.403624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:43.404377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:43.410761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:43.446467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:43.462389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-40b94ef9-8cd6-4618-9e83-f5e72a45059f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.763825 Sep 26 01:36:43.465311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 26/49] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:42 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:43.477836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:43.733519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:43.736819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:43.746140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:43.746882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:43.747796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:43.748743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:43.749438 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:43.749920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:43.987909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:43.997022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eaff32f8-d76a-4385-9c55-8871956ba217 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.618726 Sep 26 01:36:43.998325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 24/50] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:43 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:44.003332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:44.004663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:44.014041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.014587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.015113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.015938 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.016448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.017037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.150859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:44.158430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3d6ccb5-37a7-466c-a2e6-2de291951160 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.158889 Sep 26 01:36:44.159002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 25/51] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:43 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:44.241316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1efceeac-a857-41a1-b272-5bc060d4a969", "tag": "b3d81d4b-e73c-4350-861f-23d2553b2cde"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:44.245466 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:44.255642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:44.256710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.257364 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.258369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:44.259350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.260335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-31e7b8d5-3d26-495d-9531-8f5be3908bdb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.532789 Sep 26 01:36:44.261878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:43 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:44.281973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Creating event network-changed:b3d81d4b-e73c-4350-861f-23d2553b2cde for instance 1efceeac-a857-41a1-b272-5bc060d4a969 on hv-cinder-85920 Sep 26 01:36:44.282926 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 01:36:44.283472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-016afcbf-7de6-4486-8f82-25f495c0b235 req-f3cdd101-37d1-45d8-9ce6-298b9af1e4f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 01:36:44.284704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.285328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.285905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.286770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.287366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.288046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.299346 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.compute.rpcapi [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 01:36:44.300669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] Releasing lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 01:36:44.318606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a245d79-85d7-43f8-9097-f5d3276a9ed1 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158355 Sep 26 01:36:44.319216 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 26/53] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:44.494476 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:44.496158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:44.512565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.514009 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.515748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.519238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:44.519776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:44.520392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:44.708185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:44.716290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-18ae3497-d013-46db-a67f-0cd2d635fdc6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.228742 Sep 26 01:36:44.717138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:44 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:45.020931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:45.021656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:45.028978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.029464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.029920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.030611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.031055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.031475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.173107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.181419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53ec2c7e-7642-45d6-809e-2e514600b5be tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.164862 Sep 26 01:36:45.182009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 27/55] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:45 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:45.184129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:45.185390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:45.193330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=26 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:45.194644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:45.196951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.197866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.198728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.199824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.200282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.201045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.286686 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:45.287379 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:45.296311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.297503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.298598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.300754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.301575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.307153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.307153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.311650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-57ef2257-225c-4d3f-8d33-832594741c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.132565 Sep 26 01:36:45.312888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 29/56] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:45 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:45.610073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.619266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.620757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.621868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d93dc5f2-c176-475f-89bc-a8b20c269826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.340374 Sep 26 01:36:45.622428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:45 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:36:45.741107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:45.741859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:45.750020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.750244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.750959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.752216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:45.752989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:45.753756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:45.895720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:45.899213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:45.904919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1579220c-650b-4a91-9dcb-3c6f49988667 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.168024 Sep 26 01:36:45.905503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 30/58] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:45 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:46.205517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:46.206334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:46.209978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:46.222569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.223876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.225307 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.226105 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.234221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.234707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.339216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a794b36a-7e0c-48a0-9a10-b397017feafb", "tag": "02b15285-09ae-477c-be6b-9cf27ce25a1f"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:46.362159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.362544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.362974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.392879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] Creating event network-changed:02b15285-09ae-477c-be6b-9cf27ce25a1f for instance a794b36a-7e0c-48a0-9a10-b397017feafb on hv-cinder-85920 Sep 26 01:36:46.408967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-bc11d402-97d3-45c1-a7a0-a72b5fdaf682 req-db54bd1c-b021-4a04-9dcb-4597852e05c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075597 Sep 26 01:36:46.409577 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 31/59] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:36:46.423419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:46.424144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:46.431055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:46.448372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.449125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.453919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-158a2045-ee91-4028-88b2-daabc2261dd8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.252091 Sep 26 01:36:46.454511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 29/60] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:46 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:46.472140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.472873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.473352 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.474215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.562250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:46.575506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e4537a80-ea3b-44fc-aeb9-50eddfdc4f19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.164361 Sep 26 01:36:46.580478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 32/61] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:46 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:46.647114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:46.647686 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:46.654641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.655426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.656067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.657003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.657639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.658239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.816122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:46.840803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:46.840803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:46.840803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-684b3cf8-367d-463b-b2f3-7cc959788e06 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.186522 Sep 26 01:36:46.843662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 30/62] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:46 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:46.928976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:46.930739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:46.937750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.938530 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.939169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:46.939983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:46.940669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:46.941469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.202212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:47.232445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4bd09722-2027-4705-9571-44d5f0d07408 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.294416 Sep 26 01:36:47.232445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 33/63] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:46 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:47.481052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:47.481708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:47.490607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.491096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.491530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.494033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.494673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.495111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.504580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:47.600385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:47.601628 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:47.614513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.615264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.615704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.616510 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.617660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.621051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.749001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:47.761214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-70b56a34-363d-4e27-8d8c-151abfd3795e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.165294 Sep 26 01:36:47.766072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 34/64] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:47 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:47.819751 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:47.830484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b7958cb-ae1d-45ee-b5fa-c15abaa1d894 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.353743 Sep 26 01:36:47.831237 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 31/65] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:47 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:47.858606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:47.859484 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:47.867728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.870626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.871092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:47.874715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:47.874715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:47.874715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.093865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:48.122779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:48.126628 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:48.127983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-92ab666f-4e0d-439c-b016-bc21664ffa3b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.274412 Sep 26 01:36:48.130937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 35/66] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:47 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:36:48.264654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:48.265410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:48.272034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.274656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.275182 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.276003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.276640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.277248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.501717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:48.513817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90121662-c565-4994-9690-6a53a8894e87 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.260491 Sep 26 01:36:48.515116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 32/67] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:48 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:48.788458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:48.790228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:48.808581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.808581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.810800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.811552 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.812017 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.812467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.855546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:48.856307 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:48.864886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.865377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.865854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.866892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:48.868550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:48.868981 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:48.918493 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:48.927758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9f8970c4-4f0e-4e9b-95ad-087e41ffc23e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.143588 Sep 26 01:36:48.932681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 36/68] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:48 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:49.060874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:49.070218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5ec6469-3ace-4512-8481-422157d04479 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.219537 Sep 26 01:36:49.071286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 33/69] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:48 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:49.157769 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:49.158366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:49.165184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.165790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.166235 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:49.166937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.167388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.167807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:49.295503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:49.303416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:49.305164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:49.306266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f9282d3d-67ff-4301-ade8-0757a57a8e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.152463 Sep 26 01:36:49.306819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 37/70] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:49 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:49.538502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:49.539821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:49.545641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.546118 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.546549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:49.547227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.547674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.548089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:49.680507 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:49.688121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8b0143f-0fd3-45e9-b51e-467dfc3a4537 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.153406 Sep 26 01:36:49.688707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 34/71] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:49 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:49.950474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:49.951401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:49.957650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.958235 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.958681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:49.959377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:49.959986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:49.960261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.023880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.031783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e3cdbd91-1b82-4ca6-bf43-5d6a7746b9ff tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.085415 Sep 26 01:36:50.032448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 38/72] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:49 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:50.099399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:50.100041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:50.106713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.107208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.107647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.108704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.109201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.109819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.252321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.260882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f91e8c4-eb1d-42ff-8c51-2764133cfb17 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.171593 Sep 26 01:36:50.261746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 35/73] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:50 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:50.330938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:50.331554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:50.338219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.338694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.339129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.339822 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.340279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.341385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.480837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.488923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.490407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.491514 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-837a88b9-3cd4-46de-8323-6a529a5c3939 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.164580 Sep 26 01:36:50.492661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 39/74] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:50 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:50.711717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:50.712505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:50.719586 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.719586 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.719776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.720446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:50.720894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:50.721313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:50.886713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:50.894585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd6cc6f2-35e2-462c-a7e2-a2a9eb4a8758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.187151 Sep 26 01:36:50.895150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 36/75] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:50 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:51.059303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:51.060123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:51.066228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.066706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.067135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.067816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.068266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.068706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.141328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:51.148807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-df7ab707-1904-4711-bbf8-d1b08c7297bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.093953 Sep 26 01:36:51.162842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 40/76] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:51 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:51.283867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:51.284636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:51.287525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:51.292837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.293320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.293746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.294464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.294910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.295327 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.438546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:51.446481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bf99a81-1959-4e22-ad5a-e410554e7575 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.166369 Sep 26 01:36:51.447135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 37/77] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:51 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:51.518126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:51.518734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:51.525641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.526359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.526787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.527560 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.527921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.528408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.725401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:51.738275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:51.740757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:51.742295 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6f0a53ac-bc59-4c3c-8d15-d398bd231d3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.227772 Sep 26 01:36:51.755790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 41/78] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:51 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:51.920016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:51.922413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:51.930928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.931779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.932491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:51.933222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:51.933671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:51.934095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.166291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:52.178800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45ed28ac-a66a-4ba7-8860-280161630471 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.263282 Sep 26 01:36:52.189093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 38/79] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:51 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:52.196516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:52.197991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:52.201197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=8 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:52.215701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.216196 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.216655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.217351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.221923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.222752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.324978 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:52.333594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1a122796-4b16-4683-ba1a-8fd1d53b6bbe tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1295 microversion: 2.1 time: 0.142396 Sep 26 01:36:52.352093 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 42/80] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:52 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:52.471440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:52.472511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:52.483208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.487405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.488202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.489143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.489775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.490356 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.746710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:52.753768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:52.758578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.759994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.760663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.764083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b733191-4445-4184-981e-1e922d6a6605 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.296620 Sep 26 01:36:52.765299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 39/81] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:52 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:52.776255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:52.777188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:52.785223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.785936 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.786515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.787370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:52.788232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:52.789394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:52.790378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] Creating event network-changed:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:36:52.799622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-5e240c2c-f390-4d7d-b0b5-fa03e0f4527c req-2da1f1a7-57d2-4878-a5f5-aae041a93444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056259 Sep 26 01:36:52.799622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 43/82] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:36:52.993479 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.002704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.004645 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.005750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd0a118c-1c38-4a71-894e-844a8c527987 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.234498 Sep 26 01:36:53.006641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 40/83] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:52 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:53.204151 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:53.204901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:53.211571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.212050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.212736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.213500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.213952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.214374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.355976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.359920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:53.360557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:53.366104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6e7d9233-5576-480f-b89f-bdd88b9224fc tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.165982 Sep 26 01:36:53.366801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.367287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.367722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.367946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 44/84] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:53 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:53.368440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.369335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.369956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.506507 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.515725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb5b282e-19c0-4e63-b20e-9d7596427ac8 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.159508 Sep 26 01:36:53.516973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:53 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:53.786820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:53.787432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:53.794281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.794775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.795211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.795905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:53.796373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:53.796803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:53.934459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:53.942421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3ba31f41-15ed-4b14-85aa-93a445b174c9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.159409 Sep 26 01:36:53.942986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:53 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:54.032061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:54.032702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:54.039144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.039640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.040075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.040803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.041262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.041693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.174860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:54.193526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:54.196173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:54.198017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2fca42e-ce4e-4a68-9d84-2e005402767d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.170955 Sep 26 01:36:54.198835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 42/87] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:54 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:54.390561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:54.391865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:54.398649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.399274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.399715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.400512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.401447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.402111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.539240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:54.540078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:54.541216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:54.543238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:54.547357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.548125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.548797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.549549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.549697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2a7abcc5-7f49-43e4-948b-5a31ce2963e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.162950 Sep 26 01:36:54.550277 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:54 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:54.550395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.550878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.687044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:54.696116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2ca71fcc-d00d-4a6b-b922-c6a8a45a5352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.160479 Sep 26 01:36:54.696793 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 43/89] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:54 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:54.966582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:54.967787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:54.975631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.976457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.977023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:54.977737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:54.978339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:54.978981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.133806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:55.143752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d7ab60d1-2213-44e1-bb56-2404616fb7d7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.181192 Sep 26 01:36:55.144907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 47/90] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:54 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:55.223585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:55.224194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:55.230348 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.230884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.231510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.232262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.232782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.233265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.366755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:55.374822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:55.376272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:55.377418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9fb58ab-9a41-4340-bcac-165ad1d7f08e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.157762 Sep 26 01:36:55.378034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 44/91] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:55 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:55.581126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:55.583247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:55.591697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.592290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.592932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.593771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.594364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.594931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.721055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:55.721912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:55.728246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.728779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.729217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:55.729920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:55.730368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:55.730965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:56.626797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:56.640926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:56.647888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d49c354c-a51c-477d-8558-331de2582e8b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 1.072843 Sep 26 01:36:56.659272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 48/92] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:55 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:56.676681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:56.677671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:56.693653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:56.694411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:56.695552 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:56.700685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:56.701433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:56.702046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:56.891197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:56.915648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36b7f177-d6a5-4ad2-a802-5ed815b21d0e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 1.196970 Sep 26 01:36:56.935147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:55 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:56.940849 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:56.941791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:56.951599 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:56.952577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:56.955050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:56.956172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:56.956961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:56.958225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:57.600324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:57.608060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9510d60b-81a8-4bf0-ad3f-5df639512211 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.947273 Sep 26 01:36:57.610388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 49/94] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:56 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:57.634885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:57.645865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:57.657703 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:57.658948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48354e18-4fb3-4df9-8008-c2f50a757216 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.722719 Sep 26 01:36:57.659690 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 46/95] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:56 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:57.675209 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:57.676374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:57.687809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:57.688231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:57.688754 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:57.689507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:57.689969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:57.690398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:57.952462 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:57.953228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:57.959421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:57.959924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:57.960682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:57.961160 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:57.961628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:57.962052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:58.088258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:58.097001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0c37e2a9-25d3-4537-a964-ffdbfc30ae54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.425808 Sep 26 01:36:58.100305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 50/96] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:57 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:58.635324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:58.635944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:58.643868 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:58.644824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:58.645279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:58.646485 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:58.647207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:58.647878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:58.732615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:58.736438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:36:58.750933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8079319d-3d4d-4202-b25f-f09d779b5604 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.812909 Sep 26 01:36:58.753311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 47/97] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:57 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:58.770587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:58.774385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:58.785093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:58.786649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:58.787301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:58.788735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:58.789435 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:58.790041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:58.953466 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:58.969370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1b6aaeae-0c30-48ab-a8dd-662147d403bc tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.337716 Sep 26 01:36:58.971017 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 51/98] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:58 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:36:59.102466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:59.132660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:59.133964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:59.135168 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:59.138199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:59.141834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-21fcef06-0920-4079-a3ad-b9b350e612ae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.384795 Sep 26 01:36:59.144719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 48/99] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:36:58 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:36:59.146175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:59.146674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:59.147108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:59.148481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:59.149186 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:59.150532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:59.221518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84bc271-dfaf-4aac-9c18-29b9202eec84", "tag": "ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:36:59.246249 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:59.248909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:59.256410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:59.283482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] Creating event network-changed:ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c for instance b84bc271-dfaf-4aac-9c18-29b9202eec84 on hv-cinder-85920 Sep 26 01:36:59.310390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6450ccaa-b077-404d-acb5-458cc0f52924 req-00813729-a0bf-4f32-a599-96c9760925fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092041 Sep 26 01:36:59.311738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 49/100] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:36:59.490939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:36:59.536955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-86187a74-d752-4b65-a33e-9b9290fabe10 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.410831 Sep 26 01:36:59.546417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 52/101] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:59 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:36:59.780580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:36:59.781064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:36:59.790931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:59.791416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:59.791868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:36:59.792600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:36:59.793055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:36:59.793471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:00.157686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6a0f6a-2168-483e-91c0-cbc3174cc2e0", "name": "network-vif-plugged", "status": "completed", "tag": "2225fa4c-2032-458b-bdb1-24d6a09e40c1"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:00.175634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:00.176564 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:00.177394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:00.192863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] Creating event network-vif-plugged:2225fa4c-2032-458b-bdb1-24d6a09e40c1 for instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 on hv-cinder-85920 Sep 26 01:37:00.199840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-3ea0f937-0f95-443c-b8ad-42af128c211e req-f491cfbf-2bb0-4289-9075-b30cc2fd7173 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379687 Sep 26 01:37:00.207077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 53/102] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:00.216971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:00.218037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:00.227091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:00.227944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:00.228623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:00.229799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:00.231477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:00.232101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:00.528091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:00.537491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-26e59677-95d2-4454-990e-bf07b321f967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.761015 Sep 26 01:37:00.539753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 50/103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:36:59 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:00.545070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:00.546286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:00.553958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:00.554824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:00.555483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:00.557854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:00.558647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:00.559459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:01.262744 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.286453 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-51bac43e-e0df-4383-b006-269aafa6ed4e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 1.077748 Sep 26 01:37:01.291122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 54/104] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:00 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:01.305702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:01.317382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:01.342210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:01.343010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:01.344974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:01.346123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:01.351158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:01.352008 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:01.508724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.527983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.531331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.533147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df3d86eb-c1a6-4c3e-99cf-5b69716b1306 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.991694 Sep 26 01:37:01.535769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 51/105] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:00 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:01.562695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:01.563542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:01.577400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:01.578245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:01.578788 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:01.581746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:01.582282 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:01.583930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:01.796931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.806221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c2ac764c-eb03-44f6-b190-c854cee71c89 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.504055 Sep 26 01:37:01.806882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 55/106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:01 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:01.825105 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:01.836389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-153db3ff-5db5-42b8-ab94-c39557282f62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.276448 Sep 26 01:37:01.837403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 52/107] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:01 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:02.218490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "name": "network-vif-plugged", "status": "completed", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:02.229415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.229893 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.230316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.243201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] Creating event network-vif-plugged:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:37:02.248196 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-c37abd71-0484-4ef7-88b7-346beeb75699 req-ffc21b83-800e-404c-baf6-5512722991f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Sep 26 01:37:02.249391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 56/108] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:37:02.318652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:02.319678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:02.331173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.332178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.332579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.333406 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.333923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.334444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.562187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:02.563410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:02.575842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.577061 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.578087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.579348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.581817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.583485 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.625309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:02.638630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ec6134d-49b9-4000-9ba4-ac8a29b8bf6e tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.326639 Sep 26 01:37:02.652546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 53/109] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:02 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:02.838412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:02.839081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:02.855095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:02.875544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.878769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.883669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.887088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.888823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:02.890456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:02.891081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.893157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.898121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5283eb2c-ae88-4e5d-b188-3dc991a9cda8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.340647 Sep 26 01:37:02.909117 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 57/110] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:02 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:02.924940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:02.926710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:02.948736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.956524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.961637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:02.962704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:02.966195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:02.968233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:03.542380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:03.552448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b2ee69b8-fd19-4339-b499-15ebec78d92d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.641778 Sep 26 01:37:03.553217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 58/111] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:02 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:03.577663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:03.587908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ffd69ac-6c12-4006-86c7-84b6b0ce1ead tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.755344 Sep 26 01:37:03.589040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 54/112] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:02 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:03.672181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:03.673523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:03.683773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:03.685138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:03.685802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:03.687107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:03.687753 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:03.688691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:03.846408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:03.855552 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-110514a1-ba3c-4620-990b-687339ea6c47 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.189097 Sep 26 01:37:03.856578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 59/113] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:03 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:03.934982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:03.936211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:03.943620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:03.944863 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:03.945677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:03.946618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:03.947268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:03.948435 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.095887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:04.121155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:04.127565 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:04.128991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5bb41178-6337-4890-9223-726d6d8d4996 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.197789 Sep 26 01:37:04.130811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 55/114] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:03 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:04.266383 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efceeac-a857-41a1-b272-5bc060d4a969", "name": "network-vif-plugged", "status": "completed", "tag": "b3d81d4b-e73c-4350-861f-23d2553b2cde"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:04.280250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.281421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.282892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.309672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] Creating event network-vif-plugged:b3d81d4b-e73c-4350-861f-23d2553b2cde for instance 1efceeac-a857-41a1-b272-5bc060d4a969 on hv-cinder-85920 Sep 26 01:37:04.316611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-edaf1db6-c785-47eb-9500-4d99f088a0fa req-2a1a7b5a-905c-4738-80cd-6af6b571e48e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053860 Sep 26 01:37:04.317665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 60/115] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:04.575994 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:04.576621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:04.583662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.584149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.584609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.585897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.586349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.586771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.611940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:04.612882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:04.646087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.647967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.650049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.651412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.652748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.653702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.837824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:04.846018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95839840-106e-42ae-bf5e-9626faaf54d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.274056 Sep 26 01:37:04.846717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 56/116] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:04 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:04.879321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:04.879969 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:04.889380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.889875 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.890315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.891018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:04.891472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:04.891633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:04.892108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:04.901274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2bc0aa57-2972-4920-87fb-d88b40cc3294 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.293396 Sep 26 01:37:04.917507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 61/117] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:04 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:05.105145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:05.112598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd70b44e-dec6-4a9c-a21a-8fc7a43691a4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.237154 Sep 26 01:37:05.113179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 57/118] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:04 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:05.156431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:05.156934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:05.163530 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.164088 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.164878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:05.165580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.166030 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.166453 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:05.301344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:05.313800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:05.315534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:05.316756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6674475b-8369-43ae-ad8e-266b480dd431 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.164623 Sep 26 01:37:05.317740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 62/119] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:05 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:05.874333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:05.875025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:05.881212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.882460 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.883151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:05.883930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.884395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.884847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:05.926762 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:05.927437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:05.935116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.935535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.935979 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:05.936929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:05.937535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:05.938001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:06.360486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.375864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2a9e9e9-6adc-4142-9211-a14a76f2a4f2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.505489 Sep 26 01:37:06.377916 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 58/120] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:05 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:06.391090 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.393058 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:06.394396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:06.402126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-96de8621-25f6-4a01-9846-8434a5b7659e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.479666 Sep 26 01:37:06.405465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 63/121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:05 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:06.411571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:06.412292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:06.421156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:06.421732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:06.422312 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:06.423070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:06.423296 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:06.423650 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:06.424139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:06.424329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:06.425185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:06.427267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:06.429696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:06.430328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:06.817044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.826427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06e11f1c-d396-4f9b-a3cb-c564f8e99ad5 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.445839 Sep 26 01:37:06.829992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 59/122] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:06 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:06.856482 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.869168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.871192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:06.872848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ef85fb08-c774-4562-b79e-9bd08eb2547b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.465820 Sep 26 01:37:06.873475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 64/123] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:06 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:07.404625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:07.405374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:07.412123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.412923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.413538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.414217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.414734 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.415456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.437381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:07.438665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:07.448736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.450502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.450943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.451652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.452181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.452813 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.849612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:07.858894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbdfbda6-2a95-46db-8225-04cee647bda3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.459114 Sep 26 01:37:07.860048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:07 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:07.865332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:07.867257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:07.873349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.874064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.874704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.875618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.876390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.877164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.882697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:07.891651 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-30548b75-af01-4dec-9dd4-e7b341730b5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.459102 Sep 26 01:37:07.900907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 65/125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:07 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:07.909279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:07.909990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:07.917212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.917920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.918352 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:07.919473 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:07.925308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:07.926112 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:08.083593 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:08.094361 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d180ab0-da03-48f6-8b87-388adced721b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.232902 Sep 26 01:37:08.094952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:07 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:08.146596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:08.156234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:08.157710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:08.158803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-dfcc686c-aef7-4ab6-a520-efcd34da9cfa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.256697 Sep 26 01:37:08.159373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 66/127] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:07 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:08.886578 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:08.887188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:08.893142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:08.893622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:08.894055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:08.894733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:08.895180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:08.895598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:08.915361 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:08.915968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:08.922043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:08.922543 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:08.922985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:08.923676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:08.924129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:08.924612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:08.943343 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:09.087695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.095118 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46360c16-76c4-437b-9fc1-1d5bf049b9eb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.212330 Sep 26 01:37:09.095684 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 62/128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:08 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:09.104560 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.112331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-745d4c90-4a2c-4643-ab32-995c58aa0b2e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.201306 Sep 26 01:37:09.113111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 67/129] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:08 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:09.120450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:09.121080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:09.127007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:09.127478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:09.127902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:09.128605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:09.129049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:09.129463 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:09.183755 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:09.184384 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:09.190247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:09.190732 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:09.191167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:09.191852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:09.192305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:09.192758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:09.298313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.305933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-687990ce-7466-476a-bc8e-b00a192b8e3f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.190794 Sep 26 01:37:09.306521 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:09 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:09.345710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.354974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.356425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:09.357597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-eecd3f57-0984-45f6-8fe4-add2aee60c0b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1407 microversion: 2.20 time: 0.177658 Sep 26 01:37:09.358149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 68/131] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:09 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:37:09.768710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a794b36a-7e0c-48a0-9a10-b397017feafb", "name": "network-vif-plugged", "status": "completed", "tag": "02b15285-09ae-477c-be6b-9cf27ce25a1f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:09.778898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:09.779385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:09.779793 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:09.791568 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] Creating event network-vif-plugged:02b15285-09ae-477c-be6b-9cf27ce25a1f for instance a794b36a-7e0c-48a0-9a10-b397017feafb on hv-cinder-85920 Sep 26 01:37:09.796645 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2be1d59c-111f-41c6-817f-7859fcaf3b74 req-5fb87331-9d08-4a0a-9b9c-cf42c14f76a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Sep 26 01:37:09.797239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 64/132] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:10.118149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:10.118751 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:10.124852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.125392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.125875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.126549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.126983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.127794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.137151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:10.138101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:10.151091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.151699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.152480 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.153197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.153649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.154069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.342502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.349840 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.354006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:10.359857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-863c8721-090c-4130-8617-a6c212584ce3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.245729 Sep 26 01:37:10.360457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:10 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:10.364805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:10.365396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:10.369836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc8af35a-4b34-4213-b63c-2247f7684d29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.237696 Sep 26 01:37:10.384568 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:10 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:10.389486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:10.390088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:10.396197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.396606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.396714 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.397730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.398169 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.398275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.398862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.399049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.399502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.399599 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.399920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.400013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.613937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.618376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.627402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7d3a7b17-9b88-4f97-9565-9327ebe51ce9 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.265852 Sep 26 01:37:10.627660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.628298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:10 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:10.629260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:10.630971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a64a10c9-68de-41d6-a47c-b52c3135c202 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1599 microversion: 2.20 time: 0.244687 Sep 26 01:37:10.631742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 66/136] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:37:10 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1599 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:37:10.657840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:10.658330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:10.664590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.665074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.665579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.666267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:10.667192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:10.667647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:10.801708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-96240c91-7e9b-4e5e-91ef-a709cb4c28e6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.147248 Sep 26 01:37:10.803050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 71/137] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Sep 26 01:37:10 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:37:11.419216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:11.421917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:11.423745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:11.426199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:11.441986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:11.444884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:11.445713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:11.446651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:11.452743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:11.454098 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:11.454903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:11.455124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:11.455779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:11.460626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:11.465042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:11.469892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:11.967406 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:11.976415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6eef02fc-2f76-415e-b50b-f2595b62c5d6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.571457 Sep 26 01:37:11.977380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:11.977603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 72/138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:11 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:11.983163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:11.983719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:11.986008 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b5c0df4-f5ac-435f-815b-1ae02f18781a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.602146 Sep 26 01:37:11.987224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 67/139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:11 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:12.011686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:12.012180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:12.014026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:12.015039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:12.022736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:12.023262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:12.183761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:12.202231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f28efd1a-0dc5-46af-8add-4798e2a7c594 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1315 microversion: 2.1 time: 0.223447 Sep 26 01:37:12.202819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 73/140] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:11 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:12.784107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:12.815865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:12.819228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:12.821571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:12.840801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] Creating event network-changed:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:37:12.846929 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-12a584ed-c914-4d9c-8b2b-a77b486e26e0 req-570a1d50-83c3-437b-b916-0f1d87e9691c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076874 Sep 26 01:37:12.848135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 68/141] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:12.999297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:13.000756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:13.010417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:13.011621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:13.022431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.025061 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.025812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.026280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.026832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.028089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.028697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.029286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.030158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.030685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.032696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.033704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.491146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:13.499865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c3350b4-cf76-49e4-ab15-061c55130952 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.494286 Sep 26 01:37:13.500991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 69/142] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:13 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:13.516213 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:13.516864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:13.525977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.526481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.526922 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.529469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:13.530578 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:13.532666 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:13.541215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:13.551332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-27b919ae-8ce4-4d08-9be3-e1c8a9ab65da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1322 microversion: 2.1 time: 0.555594 Sep 26 01:37:13.552635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 74/143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:12 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:14.260574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:14.270137 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-afdd7b70-e56f-4041-8c2a-3845190c9bad tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1502 microversion: 2.1 time: 0.768639 Sep 26 01:37:14.285603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 70/144] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:13 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1502 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:14.536036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:14.538038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:14.577680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:14.578292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:14.592672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:14.593194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:14.602044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:14.602548 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:14.602989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:14.610003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:14.611327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:14.611827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:14.612266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:14.619485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:14.619990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:14.620467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.029584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:15.043903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-adc175ca-ac09-445c-b077-18a9fee6942c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1515 microversion: 2.1 time: 0.468709 Sep 26 01:37:15.064930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 71/145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:14 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1515 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:15.071261 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:15.073804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:15.093889 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.096275 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.101878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.102921 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.103543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.104162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.164283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:15.182425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9d47d2a5-0559-418f-9c1f-435f4f2f14b6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.651119 Sep 26 01:37:15.185844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 75/146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:14 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:15.227208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'flavor' on Instance uuid a794b36a-7e0c-48a0-9a10-b397017feafb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:37:15.408103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bcdd24d8-8aa0-45de-a98e-264e22103072 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb/action" status: 200 len: 32 microversion: 2.1 time: 0.341138 Sep 26 01:37:15.409467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 72/147] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:37:15 2022] POST /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb/action => generated 32 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:37:15.420214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:15.420873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:15.426258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=93 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:15.428542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.429274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.429785 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.430557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.431076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.431569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.649342 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:15.666174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-186b3d86-a2b4-4e41-a2ca-01113e551963 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.250165 Sep 26 01:37:15.666779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 76/148] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:15 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:15.917148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87f682dc-7d3e-47a2-802d-3dc7364702b7"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:15.920260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:15.927412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.928029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.928505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:15.929826 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:15.930688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:15.931129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.214488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:16.216024 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:16.230533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:16.233026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:16.233891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.237456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:16.239147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:16.239851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.440040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84f4040a-660b-42be-abb3-575f0b7892c6 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "POST /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531883 Sep 26 01:37:16.444633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 73/149] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:37:15 2022] POST /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:16.479632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84bc271-dfaf-4aac-9c18-29b9202eec84", "name": "network-vif-plugged", "status": "completed", "tag": "ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:16.501713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:16.502535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:16.503171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.517534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] Creating event network-vif-plugged:ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c for instance b84bc271-dfaf-4aac-9c18-29b9202eec84 on hv-cinder-85920 Sep 26 01:37:16.530632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d67bd4ff-d4cf-4f97-9484-3db6d5492f17 req-6438a759-a7e1-4cb0-a570-f852f25bfa71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068826 Sep 26 01:37:16.531767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 74/150] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:16.690243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:16.691319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:16.715019 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:16.715725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:16.718020 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.719006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:16.719940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:16.721443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:16.976609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:16.986153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-13112cb0-8a61-4d47-af35-c3701fef5259 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.778847 Sep 26 01:37:16.987368 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 77/151] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:16 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:17.130109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:17.140427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5c3f00a-0f50-472d-abd7-cac8302fb237 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.454597 Sep 26 01:37:17.141224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 75/152] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:16 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:18.013440 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:18.014292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:18.023400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:18.023959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:18.024496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:18.025257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:18.025768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:18.026507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:18.168786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:18.169393 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:18.176709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:18.177195 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:18.177713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:18.178572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:18.179018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:18.179511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:18.202982 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:18.222881 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5f996685-3a99-4a67-8eac-f3fac64947aa tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1362 microversion: 2.1 time: 0.216121 Sep 26 01:37:18.223744 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 78/153] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:18 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:18.343189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:18.351910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1623d4d7-80ae-4d67-bf6e-aaec13b8bf9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.186842 Sep 26 01:37:18.352788 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 76/154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:18 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:19.246992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:19.247687 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:19.254056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.254663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.255191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.256369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.256896 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.257480 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.375073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:19.375864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:19.383409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.384205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.384979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.386061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.386714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.387375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.491710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:19.503758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-496bda37-4d1a-4121-917b-aaeaff757e86 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1549 microversion: 2.1 time: 0.260798 Sep 26 01:37:19.504385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 79/155] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:19 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1549 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:19.535881 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:19.536398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:19.544175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.544740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.545313 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.546034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:19.546491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:19.546917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:19.650888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:19.658825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e226cf6-452f-4882-80be-85f158fb9e56 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.287596 Sep 26 01:37:19.659396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 77/156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:19 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:19.690916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-40011dda-8359-4e98-8ee9-cdc5c741dab3 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159047 Sep 26 01:37:19.691597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 80/157] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:37:19 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:20.684869 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:20.685484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:20.694517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:20.696427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:20.698898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:20.701329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:20.701635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:20.702238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:20.976763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:20.986581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-acb45d40-5c17-4354-8d7c-3d3b779ea8b4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.306519 Sep 26 01:37:21.002472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 78/158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:20 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:21.252836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84bc271-dfaf-4aac-9c18-29b9202eec84", "tag": "ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:21.266634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:21.267436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:21.268068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:21.284263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] Creating event network-changed:ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c for instance b84bc271-dfaf-4aac-9c18-29b9202eec84 on hv-cinder-85920 Sep 26 01:37:21.293457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-10fb9ed0-68ff-4395-83cf-26f5c0f903c9 req-bc35a19c-4740-4713-a9f0-87d62608cfef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044252 Sep 26 01:37:21.294094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 81/159] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:22.014188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:22.015312 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:22.024277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=83 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:22.028772 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:22.030174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:22.031770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:22.033777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:22.042927 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:22.051073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:22.349457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:22.359151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d89d88f3-8a6d-46a9-b0b8-c73a50ea3272 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.349038 Sep 26 01:37:22.360524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 79/160] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:22 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:23.150244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1102461579", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "networks": [{"uuid": "d96ae2dd-c483-48c7-84c1-82589adaae3c"}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:23.207335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] validate_networks() for [('d96ae2dd-c483-48c7-84c1-82589adaae3c', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:37:23.386779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:23.387402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:23.396317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:23.396971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:23.397264 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:23.397975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:23.398512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:23.398842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:23.429918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:23.666253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:23.676845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f16c605e-ce4b-4566-981a-23f51dff9d79 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.296684 Sep 26 01:37:23.677964 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:23 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:23.760906 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:37:23.761330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:37:23.762158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:37:23.762989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:37:23.763560 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:37:23.773754 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:23.774475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:23.775177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:23.776242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:23.776989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:23.777572 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:23.805073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Getting quotas for project db1abf10c3e24836a161f3035d7e58ca. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:37:23.811153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Getting quotas for user 44d8acef214449a085a2173930bb3ab1 and project db1abf10c3e24836a161f3035d7e58ca. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:37:23.828144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:37:23.830864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:37:23.879752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-46e0bb23-0dbe-48d5-80dc-bd86716158c0 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733862 Sep 26 01:37:23.880475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 82/162] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:37:23.893167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1aac5467-e232-4fb6-9dbd-461dd5732ab8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:23.894245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1aac5467-e232-4fb6-9dbd-461dd5732ab8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:24.007958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1aac5467-e232-4fb6-9dbd-461dd5732ab8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:24.017608 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1aac5467-e232-4fb6-9dbd-461dd5732ab8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1219 microversion: 2.1 time: 0.128726 Sep 26 01:37:24.033171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 81/163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:23 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:24.703816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:24.705241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:24.712798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:24.713358 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:24.713887 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:24.714799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:24.715346 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:24.715855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:24.862868 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:24.872443 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0892d3dd-013c-464c-a0b2-7c6b4b4df214 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.172964 Sep 26 01:37:24.873043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:24 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:25.043655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:25.045203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:25.052158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.052859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.053298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.053999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.054449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.054873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.118344 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:25.126561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da9d21a9-aae2-4b9f-ae33-115f0b923e55 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1271 microversion: 2.1 time: 0.086754 Sep 26 01:37:25.127134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:25 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:25.374912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:25.376898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:25.387950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.389063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.389823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.391031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.391837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.392629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.429398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:37:25.525303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:25.617812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-861625e1-547f-4371-8c38-ae6d7a1f7ddf tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 204 len: 0 microversion: 2.1 time: 0.248482 Sep 26 01:37:25.618455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:37:25 2022] DELETE /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:37:25.631226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:25.632023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:25.640547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.641214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.642027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.642769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.643223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.646959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.807473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:25.816667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ad31808-30db-4a0d-9e25-a95062384db8 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1554 microversion: 2.1 time: 0.190325 Sep 26 01:37:25.817262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:25 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:25.897997 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:25.898728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:25.907877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.909280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.909728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:25.910444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:25.910897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:25.912311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:26.076264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:26.086309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c183e6c3-3587-436d-8643-1e5e6530f65c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.193433 Sep 26 01:37:26.086877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:25 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:26.151058 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:26.151804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:26.158163 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:26.158654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:26.159099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:26.159794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:26.160254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:26.160708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:26.238954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:26.247167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1fce7d4-1b8d-4b87-b5d0-06fa78292007 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1277 microversion: 2.1 time: 0.100695 Sep 26 01:37:26.247732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:26 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:26.840612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:26.841169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:26.847023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:26.847496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:26.847922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:26.848624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:26.849068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:26.849484 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:26.984500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:26.994372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6fef7157-5679-4879-bf25-9c7af6c8e8a0 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1554 microversion: 2.1 time: 0.157499 Sep 26 01:37:26.995054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 86/170] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:26 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:27.110342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:27.110876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:27.117669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:27.118152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:27.118587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:27.119274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:27.119725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:27.120149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:27.248744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:27.256603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce91a28e-0ad1-440b-aea0-7da4ffe79ab7 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.150013 Sep 26 01:37:27.257474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 85/171] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:27 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:27.275426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:27.275426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:27.278105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:27.278589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:27.279016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:27.279689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:27.280137 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:27.280578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:27.344151 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:27.352857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c2c3621c-1148-4842-8f3d-9e9d59cb2068 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1277 microversion: 2.1 time: 0.086293 Sep 26 01:37:27.353424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 87/172] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:27 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:28.020572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:28.021183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:28.027741 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.028232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.028692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.029503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.030201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.030631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.183614 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:28.195892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ee4cef3-b394-4c7d-b826-d43abbefc6f7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1554 microversion: 2.1 time: 0.178940 Sep 26 01:37:28.196875 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 86/173] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:28 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:28.280901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:28.281956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:28.290255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.290757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.291173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.291863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.293507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.293507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.376304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:28.376944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:28.384675 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.385508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.385963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.386904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:28.387370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:28.387797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:28.463959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:28.467516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:28.471656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5f32e49-b814-4aa0-9b43-699a51bd7016 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1277 microversion: 2.1 time: 0.099201 Sep 26 01:37:28.472221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 87/174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:28 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:28.476486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-138d86e6-f609-484d-8751-79fe40072fc1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.201267 Sep 26 01:37:28.477045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:28 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:29.221535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:29.222254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:29.229510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.230083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.230585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.231359 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.231878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.232517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.495561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:29.496287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:29.502956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.503445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.503877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.504629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.505081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.505534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.624312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:29.632367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bc7527a0-5168-47ad-93a8-23093b03279a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1277 microversion: 2.1 time: 0.140919 Sep 26 01:37:29.632957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:29 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:29.637421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:29.638049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:29.643698 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.644184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.644655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.645348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:29.645801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:29.646223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:29.831309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:29.842376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36ea024f-955c-4f15-be5f-50ef3111514f tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1554 microversion: 2.1 time: 0.624586 Sep 26 01:37:29.857682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 88/177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:29 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1554 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:30.095569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:30.111412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0da26c1f-463f-44cf-a975-34aaead0ab5f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.477211 Sep 26 01:37:30.112706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:29 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:30.655170 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:30.655775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:30.663917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:30.664853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:30.665300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:30.666016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:30.666464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:30.667822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:30.716073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1efceeac-a857-41a1-b272-5bc060d4a969", "name": "network-vif-deleted", "tag": "b3d81d4b-e73c-4350-861f-23d2553b2cde"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:30.729145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:30.729616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:30.730403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:30.743535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] Creating event network-vif-deleted:b3d81d4b-e73c-4350-861f-23d2553b2cde for instance 1efceeac-a857-41a1-b272-5bc060d4a969 on hv-cinder-85920 Sep 26 01:37:30.750363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-daf4293d-de6b-4f64-bdec-54c5e89c711d req-38a257cd-edf9-483b-ab1f-0ff0a15cae11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038970 Sep 26 01:37:30.750974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 91/179] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:37:30.871456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:30.872065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:30.878100 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:30.878581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:30.879005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:30.879689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:30.880132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:30.880574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:30.882526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:30.891391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6dfd08c-460a-4cc1-acd5-bd769d697f37 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.240073 Sep 26 01:37:30.892165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 89/180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:30 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:30.971653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:30.980941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e3656657-cbd6-4470-82e4-276df8042f85 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1512 microversion: 2.1 time: 0.113667 Sep 26 01:37:30.981507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 92/181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:30 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1512 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:31.141347 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:31.141853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:31.148283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:31.148742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:31.149183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:31.149894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:31.150350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:31.150777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:31.338142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:31.347685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-399bec02-27b4-4e54-b5e3-81c73d8e405e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.210145 Sep 26 01:37:31.348483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 90/182] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:31 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:31.915076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:31.915689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:31.921678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:31.922164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:31.922600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:31.923287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:31.923739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:31.924163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.005392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:32.006237 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:32.012879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:32.013366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:32.013803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.014505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:32.014950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:32.015375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.091156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:32.094720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:32.099271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ac1be94-7a55-4cc0-a0b6-8586839d43d4 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1346 microversion: 2.1 time: 0.098939 Sep 26 01:37:32.099873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 91/183] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:31 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:32.102678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c1554d0f-a87f-415c-9c0d-2ffad0a31c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.192019 Sep 26 01:37:32.103244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 93/184] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:31 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:32.375157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:32.375757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:32.382962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:32.383449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:32.383884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.384613 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:32.385228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:32.385647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.514165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:32.522027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa768f2f-05b4-4ba8-ae3d-0e334b776050 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.150442 Sep 26 01:37:32.522837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 92/185] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:32 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:32.768933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3c7f9e-627e-471b-9262-606b432016bc", "tag": "9b11200b-8c13-43fa-b896-2776db96c757"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:32.778735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:32.779214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:32.779640 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:32.790854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] Creating event network-changed:9b11200b-8c13-43fa-b896-2776db96c757 for instance 1c3c7f9e-627e-471b-9262-606b432016bc on hv-cinder-85920 Sep 26 01:37:32.795425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-9b959899-2222-4f6c-ac90-f09c1a4e92f6 req-64d0d294-82ba-4dfa-9137-d028d44fa684 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030667 Sep 26 01:37:32.795993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 94/186] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:37:33.121830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:33.122439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:33.126321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:33.127003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:33.128783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.129263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.129697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.130384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.130830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.131808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.134012 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.134491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.134915 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.135595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.136065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.136508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.231240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:33.239895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-425ee47c-3ee9-4846-bcbe-ac500088e302 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1346 microversion: 2.1 time: 0.121798 Sep 26 01:37:33.246535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 93/187] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:33 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:33.337918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:33.345978 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-093a8d2f-2a34-46cb-aa6f-ecf91168eae2 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.223623 Sep 26 01:37:33.346716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:33 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:33.545402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:33.546116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:33.552224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.552816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.554003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.554993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:33.555542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:33.556023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:33.752424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:33.760823 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5631fce3-f03d-4971-bfdd-6e15d94534d1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.219448 Sep 26 01:37:33.761742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:33 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:34.262988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:34.263664 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:34.265702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.266815 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.273513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.274020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.274437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:34.275131 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.275757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.276177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:34.341613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:34.350229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2dca99bd-a821-4d84-804a-a547d54f50b7 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1346 microversion: 2.1 time: 0.091014 Sep 26 01:37:34.351342 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 96/190] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:34 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:34.369967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:34.370721 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:34.372662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:34.378532 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.379018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.379449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:34.380137 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.380616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.381598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:34.514508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:34.522299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bda15b71-a129-464e-b562-42617834993f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.156188 Sep 26 01:37:34.523066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 95/191] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:34 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:34.789748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:34.790426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:34.796504 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.796979 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.797403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:34.798278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:34.798723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:34.799164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:35.017194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:35.034350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f71a96c8-0e54-42d7-a0b9-3f397bfddd58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.249470 Sep 26 01:37:35.038058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 97/192] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:34 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:35.373246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:35.373860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:35.382302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:35.383097 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:35.383553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:35.384464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:35.384930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:35.385771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:35.419968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:35.420584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:35.421086 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:35.421603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lazy-loading 'fault' on Instance uuid 1efceeac-a857-41a1-b272-5bc060d4a969 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:37:35.471390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c365df91254de6a9217dab0280eff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089c1c6e9cb94a19b451d0da50ba9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:35.479692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84ab8337-3592-4d49-8c8e-d9d1ba6625d1 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 200 len: 1351 microversion: 2.1 time: 0.110191 Sep 26 01:37:35.480585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 96/193] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:35 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:35.550696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:35.551232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:35.558366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:35.558848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:35.559278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:35.560167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:35.560651 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:35.561072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.061151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:36.062028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:36.069210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.070010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.071345 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.072708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.073268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.073791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.074914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:36.082637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-542c0c3c-376d-40fe-8a94-fbd12dbc8ffb tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.539181 Sep 26 01:37:36.083226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 98/194] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:35 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:36.213312 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:36.216744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:36.221695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c4b6c51-9911-4089-8f9d-443d4bd9a8e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.165148 Sep 26 01:37:36.222262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 97/195] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:36 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:36.502962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:36.503583 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:36.510160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.510633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.511059 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.511736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.512180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.512625 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.526413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] HTTP exception thrown: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Request method failure captured: Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 HTTP/1.1 Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIUUvkXZr3RyKi6iy52VW4vEQA8CQAam9Vq9v0cRhxigdZe_n9Ha8q2B47ei4-YloMXYUe01fFZo-753Qgl-Bw5Jjfwi6YmXTPwF60lWft3_spqxGp415Vvr45d1XsoVpTkjkkiuQSyJO3UiILfW8Q4OYYfvb_LpF4xKpcDjQUmtSY Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:37:36.530909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089c1c6e9cb94a19b451d0da50ba9bea", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 73c365df91254de6a9217dab0280eff3 Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.532411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '1efceeac-a857-41a1-b272-5bc060d4a969'} Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:36.533353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.534802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.536092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Returning 404 to user: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:36.536092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a798c821-91a3-4883-96ab-68d5de711c2b tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 404 len: 111 microversion: 2.1 time: 0.033187 Sep 26 01:37:36.536092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 99/196] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:36 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:36.651763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:36.654074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:36.660472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.660957 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.661395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.662629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:36.663396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:36.663828 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:36.676063 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] HTTP exception thrown: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Request method failure captured: Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969/os-volume_attachments HTTP/1.1 Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIUUvkXZr3RyKi6iy52VW4vEQA8CQAam9Vq9v0cRhxigdZe_n9Ha8q2B47ei4-YloMXYUe01fFZo-753Qgl-Bw5Jjfwi6YmXTPwF60lWft3_spqxGp415Vvr45d1XsoVpTkjkkiuQSyJO3UiILfW8Q4OYYfvb_LpF4xKpcDjQUmtSY Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:37:36.684116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089c1c6e9cb94a19b451d0da50ba9bea", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 73c365df91254de6a9217dab0280eff3 Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.685691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'server_id': '1efceeac-a857-41a1-b272-5bc060d4a969'} Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:36.686428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:36.687606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:36.688951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Returning 404 to user: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:36.688951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ea2bedb-44c6-4bc6-9717-79998c25561c tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038084 Sep 26 01:37:36.688951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 98/197] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:37:36 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:37.108593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:37.109206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:37.115786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.116598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.117029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.117725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.118175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.118671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.245316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:37.246164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:37.253014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.253777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.254413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.255322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.256040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.256909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.267748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:37.280819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4f58bb25-e8d4-41cb-bf68-005e628b86b7 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.177101 Sep 26 01:37:37.281622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 100/198] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:37 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:37.433843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3c7f9e-627e-471b-9262-606b432016bc", "name": "network-vif-plugged", "status": "completed", "tag": "9b11200b-8c13-43fa-b896-2776db96c757"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:37.455030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:37.456239 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.456811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.457253 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.464449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbe5f446-7c5e-496f-9386-7918075f5f27 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.223030 Sep 26 01:37:37.472390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 99/199] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:37 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:37.472559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] Creating event network-vif-plugged:9b11200b-8c13-43fa-b896-2776db96c757 for instance 1c3c7f9e-627e-471b-9262-606b432016bc on hv-cinder-85920 Sep 26 01:37:37.475774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-59f93479-3601-4bf1-9073-b948c2fd05d7 req-3b9d200c-f0ac-43ab-a574-13aa5f98c777 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048651 Sep 26 01:37:37.476666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 101/200] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:37:37.893868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:37.894412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:37.900819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.901305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.901736 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.902429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.902885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.903311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.917346 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] HTTP exception thrown: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Request method failure captured: Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 HTTP/1.1 Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIUUvkXZr3RyKi6iy52VW4vEQA8CQAam9Vq9v0cRhxigdZe_n9Ha8q2B47ei4-YloMXYUe01fFZo-753Qgl-Bw5Jjfwi6YmXTPwF60lWft3_spqxGp415Vvr45d1XsoVpTkjkkiuQSyJO3UiILfW8Q4OYYfvb_LpF4xKpcDjQUmtSY Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:37:37.919481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089c1c6e9cb94a19b451d0da50ba9bea", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 73c365df91254de6a9217dab0280eff3 Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.920911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '1efceeac-a857-41a1-b272-5bc060d4a969'} Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:37.921674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.922757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.923834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Returning 404 to user: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:37.923834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f02c5daf-a04d-4d45-a1c8-0e7a50032b93 tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 404 len: 111 microversion: 2.1 time: 0.030886 Sep 26 01:37:37.923834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 100/201] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:37:37 2022] DELETE /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:37.930768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:37.931459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] [instance: 1efceeac-a857-41a1-b272-5bc060d4a969] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:37.937521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.938002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.938432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.939116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:37.940152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:37.940670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:37.955024 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] HTTP exception thrown: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Request method failure captured: Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 HTTP/1.1 Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIUUvkXZr3RyKi6iy52VW4vEQA8CQAam9Vq9v0cRhxigdZe_n9Ha8q2B47ei4-YloMXYUe01fFZo-753Qgl-Bw5Jjfwi6YmXTPwF60lWft3_spqxGp415Vvr45d1XsoVpTkjkkiuQSyJO3UiILfW8Q4OYYfvb_LpF4xKpcDjQUmtSY Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:37:37.956770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/089c1c6e9cb94a19b451d0da50ba9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_089c1c6e9cb94a19b451d0da50ba9bea", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 089c1c6e9cb94a19b451d0da50ba9bea Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-DeleteServersTestJSON-1469312362 Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 73c365df91254de6a9217dab0280eff3 Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-DeleteServersTestJSON-1469312362-project Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.958035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '1efceeac-a857-41a1-b272-5bc060d4a969'} Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:37.958867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. Sep 26 01:37:37.960217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:37.961416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] Returning 404 to user: Instance 1efceeac-a857-41a1-b272-5bc060d4a969 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:37.961416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2a53d2d2-90cb-4ea2-b3a9-5ef01ef456ff tempest-DeleteServersTestJSON-1469312362 tempest-DeleteServersTestJSON-1469312362-project] 10.222.0.25 "GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969" status: 404 len: 111 microversion: 2.1 time: 0.032277 Sep 26 01:37:37.961416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 102/202] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:37 2022] GET /compute/v2.1/servers/1efceeac-a857-41a1-b272-5bc060d4a969 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:38.303700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:38.304364 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:38.310517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:38.311005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:38.311438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:38.312133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:38.312630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:38.313056 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:38.489287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:38.489968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:38.496844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:38.497616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:38.498168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:38.499006 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:38.499554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:38.500074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:38.669061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:38.676759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f0674022-5a54-4bdf-9ab0-ba36b09c4db5 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.377111 Sep 26 01:37:38.677332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 101/203] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:38 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:38.699128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:38.707703 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-256abe25-fc94-4a21-a96a-87137663cf08 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.222984 Sep 26 01:37:38.708354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 103/204] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:38 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:39.700894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:39.702121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:39.710289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:39.711044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:39.711657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:39.712549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:39.713326 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:39.713755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:39.732730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:39.734211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:39.742129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:39.743192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:39.744020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:39.744969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:39.745637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:39.746394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:39.775380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:39.942775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:39.956199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7c6f21d-7826-410b-917d-9eaec788a389 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.259819 Sep 26 01:37:39.957343 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 102/205] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:39 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:39.976149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:39.986459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5f90cc21-7d4a-4630-b149-7a71d5983ee9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.257999 Sep 26 01:37:39.999041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 104/206] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:39 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:40.981162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:40.982887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:40.994292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:40.994799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:40.996429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:40.997211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:40.997683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:40.998118 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:41.017930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:41.018540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:41.025923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:41.026491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:41.027005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:41.027800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:41.028327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:41.029485 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:41.264365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:41.275915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cc0bb8e-c1e3-4452-8f86-cf781c0fd90e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1319 microversion: 2.1 time: 0.299397 Sep 26 01:37:41.282486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 103/207] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:40 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:41.360919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:41.370083 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-23c52298-5a30-496e-aab4-84040797f3da tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.355599 Sep 26 01:37:41.419225 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 105/208] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:41 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:42.301076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:42.301693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:42.310480 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:42.310990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:42.311437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:42.312179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:42.312681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:42.313825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:42.404584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:42.405738 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:42.412635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:42.413648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:42.414239 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:42.414992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:42.415502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:42.416105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:42.467059 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:42.475933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40450718-4b4e-46a0-8d9b-51726d161cec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1507 microversion: 2.1 time: 0.179987 Sep 26 01:37:42.477472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 104/209] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:42 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:42.631309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:42.642107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6adacf23-c328-4266-8596-046dd740b82f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.241570 Sep 26 01:37:42.643415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:42 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:43.430987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e7f9462-4841-4029-aad7-5542bb6a2560 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Action: 'create', calling method: .version_select at 0x7f29d3c0d1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-425559564", "metadata": {"Type": "work"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e7f9462-4841-4029-aad7-5542bb6a2560 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 121 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:37:43.450511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-425559564", "metadata": {"Type": "work"}}} Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:37:43.451918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-425559564', 'metadata': {'Type': 'work'}}}} Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.452888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 01:37:43.454285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 01:37:43.455779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 01:37:43.455779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.455779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e7f9462-4841-4029-aad7-5542bb6a2560 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.455779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e7f9462-4841-4029-aad7-5542bb6a2560 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.315004 Sep 26 01:37:43.456376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 105/211] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Sep 26 01:37:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:37:43.465980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c099a16c-d1f5-4e7f-9007-a2f948c300b9 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Action: 'create', calling method: .version_select at 0x7f29d3a04c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2096193170", "metadata": {"Type": "work"}}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c099a16c-d1f5-4e7f-9007-a2f948c300b9 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 120 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:37:43.470682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2096193170", "metadata": {"Type": "work"}}} Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: Sep 26 01:37:43.472074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2096193170', 'metadata': {'Type': 'work'}}}} Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise error Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi '0' Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.473007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 01:37:43.475507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 01:37:43.476681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 01:37:43.476681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.476681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c099a16c-d1f5-4e7f-9007-a2f948c300b9 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.476681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c099a16c-d1f5-4e7f-9007-a2f948c300b9 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010101 Sep 26 01:37:43.476681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 107/212] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Sep 26 01:37:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:37:43.482784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13d338e3-77b0-48ba-ba16-a308a697959c tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Action: 'create', calling method: .version_select at 0x7f29d3a4bee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-464913495", "metadata": {"Type": "work"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13d338e3-77b0-48ba-ba16-a308a697959c tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 118 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:37:43.487485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-464913495", "metadata": {"Type": "work"}}} Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:37:43.488909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-464913495', 'metadata': {'Type': 'work'}}}} Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.489757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 01:37:43.491332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 01:37:43.492708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 01:37:43.492708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.492708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13d338e3-77b0-48ba-ba16-a308a697959c tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.492708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-13d338e3-77b0-48ba-ba16-a308a697959c tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011033 Sep 26 01:37:43.492708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 106/213] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Sep 26 01:37:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 01:37:43.501258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-817f7786-2373-454d-9779-31d44a740fc3 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Calling method '.version_select at 0x7f29d3aa21f0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:43.531210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-817f7786-2373-454d-9779-31d44a740fc3 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] HTTP exception thrown: Volume tempest-invalid-186701334 could not be found. Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-817f7786-2373-454d-9779-31d44a740fc3 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-186701334 HTTP/1.1 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:37:43.534791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Volume tempest-invalid-186701334 could not be found. Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'tempest-invalid-186701334'} Sep 26 01:37:43.536173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-186701334 could not be found. (HTTP 404) (Request-ID: req-5f9f7237-cf17-4da5-a29a-9c6adebd8c10) Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.537503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:37:43.538842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-186701334 could not be found. Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:43.540099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-186701334 could not be found. Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-186701334 could not be found. Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-817f7786-2373-454d-9779-31d44a740fc3 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 404 to user: Volume tempest-invalid-186701334 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-817f7786-2373-454d-9779-31d44a740fc3 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-186701334" status: 404 len: 98 microversion: 2.1 time: 0.039512 Sep 26 01:37:43.541969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 108/214] 10.222.0.25 () {58 vars in 1215 bytes} [Mon Sep 26 01:37:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-186701334 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 26 01:37:43.548717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8d0b5dc-ff2f-45f2-808c-6c928eb91eff tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003748 Sep 26 01:37:43.549431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 107/215] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Sep 26 01:37:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 01:37:43.559045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3b82fdaa-888a-44d9-bd7e-a6133c13d8d6 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004382 Sep 26 01:37:43.559819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 109/216] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Sep 26 01:37:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 01:37:43.569317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c88e240-53aa-4cfe-a7ec-4f1012d2afb4 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Calling method '.version_select at 0x7f29d3a65c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:43.602435 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-2c88e240-53aa-4cfe-a7ec-4f1012d2afb4 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] HTTP exception thrown: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c88e240-53aa-4cfe-a7ec-4f1012d2afb4 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-volumes/613f599e-1fbd-4670-bee7-b7c5abc23348 HTTP/1.1 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:37:43.604478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '613f599e-1fbd-4670-bee7-b7c5abc23348'} Sep 26 01:37:43.605816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. (HTTP 404) (Request-ID: req-0aef7efe-1f1c-42ad-97d9-b399f3211f48) Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 01:37:43.607520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 01:37:43.608632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c88e240-53aa-4cfe-a7ec-4f1012d2afb4 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 404 to user: Volume 613f599e-1fbd-4670-bee7-b7c5abc23348 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c88e240-53aa-4cfe-a7ec-4f1012d2afb4 tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/613f599e-1fbd-4670-bee7-b7c5abc23348" status: 404 len: 109 microversion: 2.1 time: 0.041780 Sep 26 01:37:43.609663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 108/217] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:37:43 2022] DELETE /compute/v2.1/os-volumes/613f599e-1fbd-4670-bee7-b7c5abc23348 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:43.618072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-48d52a23-bd1c-4e90-9e9c-932c305258ab tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Calling method '.version_select at 0x7f29d3a000d0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:43.649028 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-48d52a23-bd1c-4e90-9e9c-932c305258ab tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] HTTP exception thrown: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-48d52a23-bd1c-4e90-9e9c-932c305258ab tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Request method failure captured: Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/os-volumes/764c13c3-bc88-4357-85ff-e4669c673f21 HTTP/1.1 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQJnm1b5qtnjix-_eyfwetzFraGanjPJKeLqngVBmu7bdE6ZDARkVfB0g1t8T2b6RWW8xkyXm9Xkwn6o6RGXapqoBu5b0I5OxrAxYlG0QUP3BsN5EwZvRSIfHrFERAajo1N0zfCMKmqZlj7_UrFGM5d0bEH4JcKQTpc_fOND5W7YQdE Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:37:43.651593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f9b4bce74cb425993bef9dee7fec2f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f9b4bce74cb425993bef9dee7fec2f4", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 0f9b4bce74cb425993bef9dee7fec2f4 Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesNegativeTest-1982832230 Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: b48476466c514a02a01dc280af8b3301 Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesNegativeTest-1982832230-project Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '764c13c3-bc88-4357-85ff-e4669c673f21'} Sep 26 01:37:43.653068 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. (HTTP 404) (Request-ID: req-6332a974-3915-4c5d-aa25-3b767d566659) Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.653970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:37:43.655064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 01:37:43.656244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. Sep 26 01:37:43.658205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:37:43.660332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-48d52a23-bd1c-4e90-9e9c-932c305258ab tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] Returning 404 to user: Volume 764c13c3-bc88-4357-85ff-e4669c673f21 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:37:43.662509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-48d52a23-bd1c-4e90-9e9c-932c305258ab tempest-VolumesNegativeTest-1982832230 tempest-VolumesNegativeTest-1982832230-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/764c13c3-bc88-4357-85ff-e4669c673f21" status: 404 len: 109 microversion: 2.1 time: 0.049103 Sep 26 01:37:43.663516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:37:43 2022] GET /compute/v2.1/os-volumes/764c13c3-bc88-4357-85ff-e4669c673f21 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:37:43.671078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:43.671776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:43.679359 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:43.679852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:43.680300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:43.681046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:43.681507 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:43.681939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:43.853239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:43.862120 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19750fed-0ee4-4b54-97be-6d1bef02be58 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.196462 Sep 26 01:37:43.863172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 109/219] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:43 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:44.889831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:44.890524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:44.898391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:44.898967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:44.900094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:44.901079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:44.902403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:44.902863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:45.085564 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:45.097506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2da460e6-86d6-4ef1-9329-b4c1d8870b7b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.213182 Sep 26 01:37:45.100890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 111/220] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:44 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:46.122253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:46.122892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:46.129279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:46.129792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:46.131359 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:46.132090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:46.132585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:46.133014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:46.297838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:46.307576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23cc5716-29e7-43fc-9338-c6154d279915 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.189476 Sep 26 01:37:46.308177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 110/221] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:46 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:47.336020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:47.338203 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:47.357081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:47.359538 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:47.361365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:47.363336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:47.365909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:47.366643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:47.367750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:47.577379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:47.588106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a57b825c-65c7-48ec-aaa5-9e4728e9ba2d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.259608 Sep 26 01:37:47.589077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 112/222] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:47 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:48.611793 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:48.612400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:48.619544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:48.620034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:48.620503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:48.621204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:48.621651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:48.622443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:48.773106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:48.781510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95d6f756-52f0-4de8-8209-7c13c98a7c32 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.173414 Sep 26 01:37:48.782078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 111/223] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:48 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:49.806064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:49.806917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:49.822157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:49.823547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:49.824554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:49.826646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:49.827759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:49.829003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:50.019640 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:50.028701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a568a3f9-53ba-469c-b22c-b672212b3496 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.226578 Sep 26 01:37:50.029487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 113/224] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:49 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:51.053481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:51.055083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:51.083576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:51.084569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:51.087197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:51.088145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:51.088644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:51.089080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:51.273772 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:51.282880 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf787f2a-c0f1-4ee0-89e6-d158393b02fe tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.234640 Sep 26 01:37:51.283883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 112/225] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:51 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:52.308401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:52.310076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:52.318334 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:52.320300 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:52.320898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:52.321684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:52.322733 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:52.323239 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:52.481678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:52.490763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-647abf37-e8d9-4a88-b8cf-0d7b0df3bf7e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.188679 Sep 26 01:37:52.491348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 114/226] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:52 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:53.514196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:53.514836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:53.524576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=64 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:37:53.524576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:53.524576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:53.524576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:53.524886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:53.524886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:53.524886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:53.680474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:53.695324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-99103b20-381d-4b9e-b474-49188860faaf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.185102 Sep 26 01:37:53.709475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 113/227] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:53 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:37:54.722943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:54.725149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:54.731524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:54.732148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:54.732526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:54.733534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:54.734105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:54.734565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:54.928574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:54.937245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5e28d014-52f5-4f49-a5a6-4c854938c569 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.218027 Sep 26 01:37:54.937992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 115/228] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:54 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:55.962191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:55.962804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:55.969445 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:55.969926 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:55.970362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:55.971051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:55.971502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:55.971954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:56.125123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:56.133961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4db40ee8-57c6-4f90-a898-07b17895f127 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.175766 Sep 26 01:37:56.134529 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 114/229] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:55 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:57.158970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:57.159647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:57.165756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:57.166235 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:57.166699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:57.167381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:57.167823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:57.168236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:57.298305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:57.306931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fd1881b7-aad6-4bdb-8a58-d89dbfc09aaa tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.152059 Sep 26 01:37:57.307578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 116/230] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:57 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:58.331067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:58.331706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:58.339128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:58.339622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:58.340420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:58.340862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:58.341318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:58.341744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:58.482812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:58.491196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d444d1a3-a7dd-4ee5-867e-b09e1187fe84 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.164110 Sep 26 01:37:58.491958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 115/231] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:58 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:37:59.522430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:37:59.523907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:37:59.532778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:59.534166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:59.534834 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:59.536246 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:37:59.537323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:37:59.538178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:37:59.706588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:37:59.715304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-41ef7f62-e1fa-49cb-860c-70997766902e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.201433 Sep 26 01:37:59.715872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 117/232] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:37:59 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:00.737875 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:00.739069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:00.746203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:00.746937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:00.747543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:00.748443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:00.749045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:00.749642 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:00.998544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:01.009138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec7939be-5e53-4e22-85ae-2429d9492892 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.274515 Sep 26 01:38:01.010612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 116/233] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:00 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:02.041736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:02.045480 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:02.059874 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:02.065605 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:02.066130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:02.069647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:02.070119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:02.072844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:02.315070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:02.324319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3091b766-cc5c-4b97-9f32-43aacfb5272c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.287572 Sep 26 01:38:02.325507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 118/234] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:02 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:03.346976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:03.347583 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:03.355220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:03.355715 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:03.356153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:03.356903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:03.357375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:03.357806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:03.496439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:03.504412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30f8b01f-6531-4246-9861-757b8c2136a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.161200 Sep 26 01:38:03.505022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 117/235] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:03 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:04.527108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:04.527837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:04.533798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:04.534382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:04.534886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:04.535588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:04.536040 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:04.537014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:04.671543 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:04.680634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1cc35524-7168-4260-9df6-31bfd8b63c09 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.157068 Sep 26 01:38:04.681221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 119/236] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:04 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:05.702935 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:05.703687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:05.710376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:05.710857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:05.711292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:05.711974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:05.712444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:05.712868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:05.875178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:05.882932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bde577d4-205c-4537-8e7d-24fa115172f2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1521 microversion: 2.1 time: 0.183774 Sep 26 01:38:05.883502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 118/237] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:05 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:06.907947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:06.909433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:06.916526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:06.917159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:06.917604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:06.918316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:06.918770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:06.919371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:07.070961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:07.080465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7f5cb552-dc72-406b-8e59-5ddf61600fdd tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1501 microversion: 2.1 time: 0.176990 Sep 26 01:38:07.081046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 120/238] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:06 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:07.106444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:07.107051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:07.116385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:07.116935 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:07.117374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:07.118081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:07.119141 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:07.119585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:07.124951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:07.260748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:07.270090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3bd3c6b-b008-4d94-98fa-4e73253a74a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1514 microversion: 2.1 time: 0.167293 Sep 26 01:38:07.271756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 119/239] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:07 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:08.707212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:08.708290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:08.716909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.717514 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.718067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:08.719278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.719743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.720546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:08.755483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:08.758662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:08.765906 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a3da9dad-a6ce-4c88-bd58-b3a877958691 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/ips" status: 200 len: 152 microversion: 2.20 time: 0.063885 Sep 26 01:38:08.766489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 121/240] 10.222.0.25 () {60 vars in 1289 bytes} [Mon Sep 26 01:38:08 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/ips => generated 152 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:38:08.772439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.773810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.774983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:08.775899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.776697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.777357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:08.808373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'flavor' on Instance uuid 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:38:08.903728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30b14ce7-be18-43a5-bbfc-bd4e9838d0a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/action" status: 200 len: 32 microversion: 2.1 time: 0.152986 Sep 26 01:38:08.904422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 120/241] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:38:08 2022] POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:38:08.914817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:08.915985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:08.924787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.925282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.925776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:08.926473 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:08.928373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:08.929198 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:09.232661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:09.246456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ab18cb3c-574e-4dfb-98bf-efc37505cc11 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.335934 Sep 26 01:38:09.247529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 122/242] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:08 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:10.279910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:10.280681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:10.287458 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:10.287925 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:10.288383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:10.289083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:10.289533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:10.290156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:10.475370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:10.483449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc6cbec9-cc47-4d08-bccf-54944db164d8 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.208146 Sep 26 01:38:10.484044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 121/243] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:10 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:11.236086 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60164cca-b7f7-4637-b7e5-497c9d291d57", "device": "/dev/sdb"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:11.240882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:11.250176 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.251037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.251909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.253065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.253879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.254665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.264257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=85 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:11.510430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:11.511431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:11.519219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.520620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.521585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.522517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.523155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.523809 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.710779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:11.724073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2dcce4c-cebc-4b39-82e0-8d294e4c70cb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.219403 Sep 26 01:38:11.724643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3e05f7d8-3dee-49b1-8a5a-870c96c0c98f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "POST /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492360 Sep 26 01:38:11.725154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 122/244] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:11 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:11.728724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 123/245] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:38:11 2022] POST /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:11.733408 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:11.734038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:11.742474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.743157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.743803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.745209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:11.747487 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:11.748181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:11.780140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'flavor' on Instance uuid 8390f758-83d5-4553-910b-5ec8bcb93ce6 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:38:12.176248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3941ae38-d736-42eb-93a0-358275821f55 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/action" status: 202 len: 0 microversion: 2.20 time: 0.446366 Sep 26 01:38:12.181932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 123/246] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Sep 26 01:38:11 2022] POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:38:12.186763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:12.187549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:12.217058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:12.220974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:12.221796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:12.224726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:12.228170 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:12.232810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:12.521346 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:12.531654 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:12.533130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:12.535276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5293c303-6bec-451b-9a87-3225c33787b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.354208 Sep 26 01:38:12.535986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 124/247] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:12 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:12.750424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:12.751126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:12.760754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:12.761250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:12.761708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:12.762417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:12.762872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:12.763298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:12.972145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:12.986899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c67215a1-04b4-4b65-b25a-e3ce042d9012 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.241161 Sep 26 01:38:12.987415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 124/248] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:12 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:13.563231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:13.564733 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:13.576941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:13.577432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:13.577870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:13.578634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:13.579198 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:13.579511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:13.786021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:13.797565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:13.805692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:13.808571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ac1935ce-2b46-4965-aa2d-5e2a647660d6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.247969 Sep 26 01:38:13.809463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 125/249] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:13 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:14.015725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:14.016540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:14.023948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:14.024426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:14.025192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:14.026061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:14.026631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:14.027372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:14.199437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:14.215026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40cec38e-84cc-4c82-a56e-55bb64f336f5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.203779 Sep 26 01:38:14.216910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 125/250] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:14 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:14.840623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:14.841402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:14.849869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:14.850728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:14.851327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:14.852221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:14.852890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:14.853322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:15.020641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:15.029243 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:15.030886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:15.032148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-94dfa987-d8c7-4a41-b80e-f87ab95a3406 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.197196 Sep 26 01:38:15.033199 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 126/251] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:14 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:15.241641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:15.244411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:15.251704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:15.252698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:15.253392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:15.254533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:15.255221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:15.255870 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:15.658297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:15.666928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1dd29407-c958-48ab-bc28-72b84861943d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.430697 Sep 26 01:38:15.667592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 126/252] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:15 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:16.058958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:16.059749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:16.069506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:16.069506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:16.070106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:16.071322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:16.071454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:16.072270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:16.279029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:16.288583 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:16.290089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:16.291304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b042f248-5856-4ec7-9e8a-edd9444c41b1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.236222 Sep 26 01:38:16.292084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 127/253] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:16 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:16.694994 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:16.695637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:16.702397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:16.702884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:16.703364 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:16.704011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:16.704514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:16.704937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:16.865933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:16.874891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a434f278-c11a-4a2d-a970-e97adf58d767 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.186383 Sep 26 01:38:16.875566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 127/254] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:16 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:17.318321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:17.319501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:17.326523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:17.327291 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:17.328309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:17.329214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:17.329835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:17.330295 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:17.633333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:17.641859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:17.643486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:17.645565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-43a22994-8787-4bf9-b8fe-fda6aa3b2e9e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.331184 Sep 26 01:38:17.661637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 128/255] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:17 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:17.902841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:17.907223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:17.915979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:17.916805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:17.917398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:17.919219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:17.919832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:17.920445 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:18.179909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:18.190439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ec024e0-aaa7-4020-9bb6-dfc0ed675804 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.293200 Sep 26 01:38:18.191031 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 128/256] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:17 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:18.673418 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:18.674534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:18.676575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=34 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:18.681957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:18.682445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:18.683297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:18.684595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:18.685287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:18.686092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:18.858005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:18.872951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:18.874619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:18.882895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f3a7e5ef-a244-4c2f-b5eb-1dff1362bc51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.213732 Sep 26 01:38:18.883848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 129/257] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:18 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:19.218892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:19.219516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:19.232060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:19.232460 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:19.233265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:19.234323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:19.235065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:19.236176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:19.438757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:19.451338 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-423acd9c-dff2-4936-8f50-e11b1f446d61 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.237017 Sep 26 01:38:19.452242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 129/258] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:19 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:19.913285 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:19.914345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:19.924501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:19.931071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:19.931071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:19.931071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:19.931071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:19.931470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:20.115233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:20.124234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:20.126091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:20.127489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-243ab01c-0396-44c0-9b69-a567b3494fbd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.219756 Sep 26 01:38:20.128147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 130/259] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:19 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:20.428767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:20.429801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:20.437698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:20.438201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:20.438644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:20.439391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:20.440255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:20.440558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:20.492375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd74cf03-e8e3-4233-ab8d-20969cdd0384 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/ips" status: 200 len: 147 microversion: 2.1 time: 0.060406 Sep 26 01:38:20.492375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 130/260] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:38:20 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/ips => generated 147 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:20.493825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:20.494600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:20.505752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:20.506372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:20.506816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:20.508792 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:20.509469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:20.509926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:20.676872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:20.685780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-aadda359-ef81-4529-8c1f-7b546a7b4beb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.208980 Sep 26 01:38:20.686349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 131/261] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:20 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:21.153242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:21.153850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:21.162918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:21.163409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:21.164044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:21.165002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:21.165618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:21.166052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:21.345762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:21.358846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:21.360995 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:21.362652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c84102ab-e52a-4bca-8b4c-158723fa0c30 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.213165 Sep 26 01:38:21.363962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 131/262] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:21 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:21.712132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:21.712837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:21.719010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:21.719499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:21.719935 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:21.720731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:21.721183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:21.721816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:21.886201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:21.895155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0555e971-1a0e-4138-8be8-0c1db23312a3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.186855 Sep 26 01:38:21.908751 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 132/263] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:21 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:22.392448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:22.393067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:22.407767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:22.408555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:22.409253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:22.410207 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:22.414556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:22.415459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:22.427066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:22.815186 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:22.824915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:22.826899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:22.828468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35914737-33d3-4072-98dc-45eea33da8e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.443281 Sep 26 01:38:22.830003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 132/264] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:22 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:22.920906 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:22.922953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:22.933384 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:22.934734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:22.935618 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:22.936708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:22.937402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:22.938038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:23.151284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:23.159844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-afda3687-bcee-47c1-8047-b2d426338f85 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.244116 Sep 26 01:38:23.161237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 133/265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:22 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:23.856985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:23.857736 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:23.859905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=40 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:23.874470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:23.874968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:23.875409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:23.876140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:23.876631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:23.877056 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:24.187111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:24.189220 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:24.220686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:24.233330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:24.234005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:24.234766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:24.237667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:24.240170 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:24.250267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:24.282359 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:24.288699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:24.294620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00505369-5f5f-4e26-ae4d-24510f835d57 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.438908 Sep 26 01:38:24.297428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 133/266] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:23 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:24.685318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:24.703916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d1a2b4f5-4c9e-4951-b6ae-fcffb8e3c157 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.523936 Sep 26 01:38:24.705276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 134/267] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:24 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:25.266448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4a24b26-4b41-437b-a0fa-e8d25d2e971d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Action: 'create', calling method: .version_select at 0x7f29d50addc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1697878717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN2OeplbU5rCLjGP0ZivcnR1LuX6gx6dQvipMEF01OYyl3NGn6iQbVLPBNfzBq3XtbAEgS51o+DYSuezpxYf4J8a1/HuQ1iUDgPhV/rgSPykuV4QcS3nZ4Hlu5JdcuijQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:25.283508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-e4a24b26-4b41-437b-a0fa-e8d25d2e971d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Getting quotas for project d1d406b57f894053834ce17fa63fa6ac. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:38:25.288674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-e4a24b26-4b41-437b-a0fa-e8d25d2e971d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Getting quotas for user 5c72b19a91804de398c476c5e1c404cf and project d1d406b57f894053834ce17fa63fa6ac. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:38:25.311509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4a24b26-4b41-437b-a0fa-e8d25d2e971d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.217586 Sep 26 01:38:25.312123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 134/268] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:38:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:25.334726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:25.335523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:25.342907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:25.343472 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:25.344013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:25.345074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:25.345546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:25.346458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:25.597439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:25.617669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:25.619373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:25.620772 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ca467d5a-a5b0-4a0d-8bd2-4cc3bcae96be tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.290830 Sep 26 01:38:25.621312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 135/269] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:25 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:25.731090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:25.731701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:25.739575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:25.740072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:25.740557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:25.741275 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:25.741735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:25.742165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:25.908315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:25.917890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-475552d5-4ab8-47b0-b96b-458c1d607f1a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.190432 Sep 26 01:38:25.918483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:25 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:26.657498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:26.658104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:26.665031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:26.665612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:26.666416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:26.667191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:26.667706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:26.668191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:26.863718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:26.878509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:26.880614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:26.881821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-29dc52bc-a8a0-436a-a686-6633d7e08f91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.228213 Sep 26 01:38:26.887014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 136/271] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:26 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:26.943150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:26.943836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:26.950300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:26.950790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:26.951232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:26.951934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:26.952413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:26.952846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:27.094404 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:27.102887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-281af051-d1c1-4f71-a18c-ad9f0e182491 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.163739 Sep 26 01:38:27.103483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 136/272] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:26 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:27.913217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:27.914159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:27.920611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:27.921330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:27.921835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:27.922595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:27.923132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:27.923651 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:28.082430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:28.091777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:28.093430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:28.094804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-20a4c7ab-2e9e-4b47-b23d-4a1b280cef98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.186056 Sep 26 01:38:28.095363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 137/273] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:27 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:28.126907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:28.127501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:28.136783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:28.137158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:28.137598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:28.138304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:28.138898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:28.139330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:28.312855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:28.324301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05dff27d-d246-43c1-8b62-89f0b25c80b2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.200423 Sep 26 01:38:28.325191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:28 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:28.791639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a2fdfd2-6791-4e92-b71f-09e7980dd8b6"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:28.794888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:28.804728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:28.805607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:28.806129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:28.806947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:28.807705 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:28.808534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:28.829620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:29.122374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:29.123997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:29.133798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:29.134942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:29.135543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:29.136527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:29.137158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:29.138922 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:29.323944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:29.333727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:29.335300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:29.337557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b7f1054-5efd-47e4-ab7a-74bc0767852c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.218751 Sep 26 01:38:29.337557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 138/275] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:29 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:29.350557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:29.351244 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:29.358997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:29.359498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:29.359967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:29.360818 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:29.361272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:29.361700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:29.532687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:29.542712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3004b9e7-f429-400e-aa6c-e95feeedc9b0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.198533 Sep 26 01:38:29.543301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 139/276] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:29 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:30.365178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:30.365835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:30.372759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:30.373343 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:30.373781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:30.374549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:30.375090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:30.375512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:30.510572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:30.519641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:30.521151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:30.522329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a59453d-6feb-460d-9994-b609490469bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.163177 Sep 26 01:38:30.522887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 140/277] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:30 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:30.567827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:30.568869 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:30.575089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:30.575576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:30.576017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:30.576750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:30.577204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:30.577634 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:30.714781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:30.723315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-821aeb60-1e0d-4133-93c7-c6a59738ecde tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.159358 Sep 26 01:38:30.723874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:30 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:31.549966 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:31.551328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:31.557616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:31.558103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:31.558545 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:31.559242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:31.559700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:31.560112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:31.695694 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:31.703954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:31.705473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:31.707169 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41dff428-4391-4e65-92f3-5bca17a3b391 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.160695 Sep 26 01:38:31.707726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 142/279] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:31 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:31.747009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:31.747609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:31.754201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:31.755013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:31.755452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:31.756138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:31.756624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:31.757047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:31.889651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:31.898293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04332746-710c-4234-a1d5-d259f30bc947 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.155196 Sep 26 01:38:31.898858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 143/280] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:31 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:32.736752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:32.738588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:32.747918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:32.749069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:32.749509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:32.750297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:32.751083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:32.751802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:32.930189 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-37ed79af-930b-40e8-9cba-93066e9e8a27 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.143974 Sep 26 01:38:32.931715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 138/281] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:38:28 2022] POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments => generated 194 bytes in 4147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:32.937815 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:32.938741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:32.946983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:32.948872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:32.950025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:32.950978 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:32.951660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:32.952332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:32.980692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:32.990555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:32.992862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:32.994068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c71fae31-417e-42eb-a220-af2d15d4c1b3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.263544 Sep 26 01:38:32.997488 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 144/282] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:32 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:33.125642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:33.134389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-424924a5-6cb5-422d-be06-bd6adf7f7dbb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.200922 Sep 26 01:38:33.134963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 139/283] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:32 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:34.029181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:34.030027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:34.038010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:34.038605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:34.039144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:34.039950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:34.040537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:34.041067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:34.157135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:34.157793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:34.172777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:34.175454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:34.175980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:34.176985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:34.177529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:34.177959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:34.276619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:34.285495 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:34.286982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:34.288085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-94d2e15f-ebd3-4fa3-95d5-85c92199a1b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.262984 Sep 26 01:38:34.288956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 145/284] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:34 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:34.352797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:34.360460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4ced4e88-56dc-4795-be27-993fe8e117a9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.207244 Sep 26 01:38:34.361123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 140/285] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:34 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:35.313143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:35.313652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:35.315963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:35.321608 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.322094 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.322526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.323221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.323675 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.324095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.384832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:35.385743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:35.395439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.396394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.397070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.398513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.399223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.400208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.525865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:35.534188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:35.535779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:35.537154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03c6de99-31ab-4244-8581-995d419663ac tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1745 microversion: 2.20 time: 0.227864 Sep 26 01:38:35.537955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 146/286] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:35 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:35.572023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:35.579766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-543f4b1c-17c2-45ef-b060-71f8c51eec53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1500 microversion: 2.1 time: 0.198742 Sep 26 01:38:35.580374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 141/287] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:35 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1500 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:35.605044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3beda97f-39a3-4d40-b225-a808290dccec"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:35.607369 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:35.613744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.614297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.614777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.615534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.616055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.616603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.651070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] HTTP exception thrown: Cannot 'attach_volume' instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 while it is in vm_state rescued Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Request method failure captured: Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/os-volume_attachments HTTP/1.1 Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 74 Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIV3ytJr8s59BPv6dWRgb8A2pmf2ES3DLTj-vxtS0YBzn7406tdAFU9AmK3JOsdFQLoGiDS-abYnAjNjXB2LS3AVwnHb8nYxDdHjR5CdEXs1dMJkzu9F2pkF3kzpFmphRE_3l_Tj86gs5QgYO4R1NSuAEdaupwbz52fiWIFkl5o7zQ Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:38:35.652931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a553921e97994322b71fda7d032ed8bf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: fb54ba1355004e14b8dc43cf3c028e67 Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {"volumeAttachment": {"volumeId": "3beda97f-39a3-4d40-b225-a808290dccec"}} Sep 26 01:38:35.654553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Cannot 'attach_volume' instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 while it is in vm_state rescued Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'server_id': '8e6a0f6a-2168-483e-91c0-cbc3174cc2e0', 'body': {'volumeAttachment': {'volumeId': '3beda97f-39a3-4d40-b225-a808290dccec'}}} Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:38:35.655355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 while it is in vm_state rescued Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:38:35.656573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 while it is in vm_state rescued Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Returning 409 to user: Cannot 'attach_volume' instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 while it is in vm_state rescued {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44fe5afe-f7e2-4a38-b8f8-8d8855bd5301 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053389 Sep 26 01:38:35.657895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 147/288] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:38:35 2022] POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 01:38:35.664571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:35.665172 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:35.671190 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.671710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.672356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.673406 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.674146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.674582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.742475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-634a82cf-c469-4e01-bb58-ce3617531cff tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.082547 Sep 26 01:38:35.743534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 142/289] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:38:35 2022] POST /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 01:38:35.754366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:35.755891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:35.763152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.763914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.764564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:35.765856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:35.768954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:35.770525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:36.223814 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:36.232759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-872d0090-dcd1-4c19-9ade-44c0b57802e3 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1508 microversion: 2.1 time: 0.484568 Sep 26 01:38:36.240874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 148/290] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:35 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:36.567434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:36.569222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:36.577389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:36.577886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:36.578324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:36.579166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:36.579621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:36.580227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:36.757740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:36.766128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:36.767911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:36.770039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c6ae0cf8-4da8-49b5-9b07-a024fce7344d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1745 microversion: 2.20 time: 0.210590 Sep 26 01:38:36.770923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 143/291] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:36 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:37.260810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:37.262377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:37.280691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.281345 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.281905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.283077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.283628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.284676 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.545044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:37.555065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc4c372f-7cff-4e90-b96c-b067e79f9df4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1508 microversion: 2.1 time: 0.298484 Sep 26 01:38:37.556122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 149/292] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:37 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:37.623598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:37.624135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:37.631020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.631513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.631944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.632666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.633129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.633539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.770889 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'services' on Instance uuid 1c3c7f9e-627e-471b-9262-606b432016bc {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:38:37.795549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:37.796156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:37.802982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.803465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.803894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.804804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:37.805278 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:37.805696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:37.809816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:37.912885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-27916c83-c69c-4616-a6dd-ff59a2946ff3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc/os-volume_attachments/60164cca-b7f7-4637-b7e5-497c9d291d57" status: 202 len: 0 microversion: 2.1 time: 0.289042 Sep 26 01:38:37.916965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 144/293] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:38:37 2022] DELETE /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc/os-volume_attachments/60164cca-b7f7-4637-b7e5-497c9d291d57 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:38:37.983295 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:37.998616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:38.000330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:38.001982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7489b1b2-59ab-4168-9bb2-8a8071b1382c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1745 microversion: 2.20 time: 0.210518 Sep 26 01:38:38.002824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 150/294] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:37 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:38.579044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:38.580070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:38.587535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:38.588104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:38.588680 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:38.589605 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:38.590072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:38.590505 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:38.724066 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:38.731598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-07293b40-032d-4c9e-9a25-fbc01f08a55b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1508 microversion: 2.1 time: 0.157292 Sep 26 01:38:38.732171 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 145/295] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:38 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:39.028443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:39.029125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:39.045974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:39.054027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:39.054600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:39.055417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:39.055882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:39.056308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:39.203450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:39.214498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:39.216264 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:39.217844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb5cd805-f07b-4de7-afa4-2491b8bb79b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1745 microversion: 2.20 time: 0.193514 Sep 26 01:38:39.218712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 151/296] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:39 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:39.236571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "name": "network-vif-plugged", "status": "completed", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:39.247803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:39.248502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:39.249147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:39.262376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] Creating event network-vif-plugged:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:38:39.267596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-b7b42597-d827-465a-a88a-a44b5906652b req-9b592722-9363-431f-b67a-eb03fdede61e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037901 Sep 26 01:38:39.268186 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 146/297] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:39.626111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1968209156", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "networks": [{"uuid": "03bf27a4-e655-4790-88ee-39ba306a1cc8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:39.679438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] validate_networks() for [('03bf27a4-e655-4790-88ee-39ba306a1cc8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:38:39.756145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:39.757104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:39.763879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:39.764531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:39.765208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:39.766147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:39.766674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:39.767321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:39.988506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:39.996691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-31566009-9dea-4f65-a69a-d713baffd86c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1514 microversion: 2.1 time: 0.245268 Sep 26 01:38:39.997348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 147/298] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:39 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:40.133099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:38:40.133615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:38:40.134083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:38:40.134493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:38:40.134930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:38:40.145400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:40.145886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:40.146328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:40.147067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:40.147523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:40.147951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:40.165764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Getting quotas for project 3d84eb826e054de3a831769967d5ed91. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:38:40.170908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Getting quotas for user af260a85502047dc960f8ed19df299d6 and project 3d84eb826e054de3a831769967d5ed91. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:38:40.183640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:38:40.186011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:38:40.236958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8716e5dd-8655-4e51-a08f-380c0e587eca tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614666 Sep 26 01:38:40.238263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 152/299] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:38:40.249328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7e5f5d9-4387-4823-80f5-ee1ad60d573c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:40.249948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f7e5f5d9-4387-4823-80f5-ee1ad60d573c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:40.251653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:40.252585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:40.278448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:40.279015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:40.279519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:40.280463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:40.280977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:40.281573 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:40.343795 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f7e5f5d9-4387-4823-80f5-ee1ad60d573c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:40.368720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7e5f5d9-4387-4823-80f5-ee1ad60d573c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1214 microversion: 2.1 time: 0.121079 Sep 26 01:38:40.376996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 153/300] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:40 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:40.477199 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:40.485954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:40.488330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:40.489677 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-65c95799-fd6f-4384-9397-f73fcaed8563 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1745 microversion: 2.20 time: 0.244082 Sep 26 01:38:40.490226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 148/301] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:40 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1745 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:41.391973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:41.396074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:41.413336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.413915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.415576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.417930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.418400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.418832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.457937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e560c1c8-ca95-4d33-a61b-de817acfc458 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: .version_select at 0x7f29d39bbee0>, body: {"keypair": {"name": "tempest-keypair-1376116333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQnextZfQfWZNE0WNLNPoHVEyv3kfGycnYoBZqbE/fwUh/BFiFUd9qrdVdOHL+cf4YE3FA8OB9Q+2P2jbHJYluXDDhaA+iH5N2iKnF6jS5LYbSsHIn7ZYd0MxrBlI03sA=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:41.475044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e560c1c8-ca95-4d33-a61b-de817acfc458 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for project a553921e97994322b71fda7d032ed8bf. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:38:41.483559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e560c1c8-ca95-4d33-a61b-de817acfc458 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for user fb54ba1355004e14b8dc43cf3c028e67 and project a553921e97994322b71fda7d032ed8bf. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:38:41.503662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:41.517421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6747bfaa-7ec1-4720-866c-5d4ead3f9c65 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1266 microversion: 2.1 time: 0.129814 Sep 26 01:38:41.518018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 154/302] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:41 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:41.518967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e560c1c8-ca95-4d33-a61b-de817acfc458 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064391 Sep 26 01:38:41.519773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 149/303] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:38:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:38:41.541710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:41.542449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:41.552570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.553653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.554469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.555215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.555756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.556351 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.679115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:41.686154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.686650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.687146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.730002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:41.744630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:41.747096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:41.748937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a5368b3-e3fb-45a7-bfeb-96ee30519b46 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.214015 Sep 26 01:38:41.750062 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 155/304] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:41 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:41.776464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Going to try to stop instance {{(pid=127126) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 01:38:41.836457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-47dca37f-83c3-4924-ab10-5938cce9130b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action" status: 202 len: 0 microversion: 2.1 time: 0.162277 Sep 26 01:38:41.840378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 150/305] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:38:41 2022] POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 01:38:41.848651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:41.848651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:41.859805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.860376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.860814 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:41.861538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:41.862001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:41.866248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:42.064949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:42.075817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-898e443f-52c0-4d8f-8b7d-c0f102c76c76 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.233798 Sep 26 01:38:42.089897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 156/306] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:41 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:42.541623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:42.542374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:42.548418 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:42.548903 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:42.549338 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:42.550368 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:42.550934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:42.551355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:42.631046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:42.645127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-eea870cc-b2c2-4ca5-96c6-ceee390d7bb4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1266 microversion: 2.1 time: 0.106879 Sep 26 01:38:42.646163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 151/307] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:42 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:42.778547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:42.779330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:42.792858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:42.793798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:42.794368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:42.795243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:42.795823 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:42.796754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.104306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:43.105737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:43.114184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.114715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.115114 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.121857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.126122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.126892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.268660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.278860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.286414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.287746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ddc5ac3-cfe4-4468-8975-c5994d9fc16e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.515702 Sep 26 01:38:43.310471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 157/308] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:42 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:43.333418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:43.333913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:43.340940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.342356 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.342961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.344930 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.346230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.347919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.392631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:38:43.463906 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.469570 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:43.480379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b990455b-4774-4f43-bb5d-44486f57bd9d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.380522 Sep 26 01:38:43.481617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 152/309] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:43 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:43.558573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d577f6ac-8ae5-4baf-adda-9149847247f4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 204 len: 0 microversion: 2.1 time: 0.229818 Sep 26 01:38:43.566265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 158/310] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:38:43 2022] DELETE /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:38:43.577074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:43.578330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:43.591122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.592328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.596121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.599028 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.600299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.601990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.681150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:43.684635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:43.697748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.703999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.704685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.705412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:43.706566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:43.706850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:43.823782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.832542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-901ab628-e7b9-483b-bd3a-f142dc231fe2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1266 microversion: 2.1 time: 0.156837 Sep 26 01:38:43.834074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 159/311] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:43 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:43.840960 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1656519380", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a09d4722-058c-40eb-9bf4-6c4a707b96c6"}], "security_groups": [{"name": "tempest-securitygroup--1450505311"}], "key_name": "tempest-keypair-1376116333", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:43.884838 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:43.893326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8ba5cf01-1082-4cf9-b651-6fbc3672698c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.321882 Sep 26 01:38:43.894696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 153/312] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:43 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:44.319042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:44.319913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:44.326577 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.327067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.327493 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.328180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.328825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.329405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.528063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:44.539844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:44.541891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:44.543178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d419275f-40c9-420f-b4bf-b6cf30616b60 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.228935 Sep 26 01:38:44.544140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 154/313] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:44 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:44.549434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:44.551036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:44.567898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.568736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.570224 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.571728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.573464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.574109 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.751502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:44.761023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-880f0a0d-6673-44f4-b02a-a91263585f06 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.215628 Sep 26 01:38:44.777077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 155/314] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:44 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:44.860804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:44.861407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:44.879141 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.879882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.880509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.881210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.881657 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.882260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.952814 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:44.962628 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4bbe77cc-6f13-44db-a61c-13863e44e5a9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1274 microversion: 2.1 time: 0.105622 Sep 26 01:38:44.963659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 156/315] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:44 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:44.968659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:44.969701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:44.976973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.977791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.978469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:44.979654 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:44.980371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:44.981054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:45.133077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:45.141698 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-99d40168-551f-4bd2-a86e-cf10780b3766 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.176663 Sep 26 01:38:45.142660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 157/316] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:44 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:45.576328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:45.577107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:45.590148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:45.590795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:45.591390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:45.592232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:45.597472 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:45.598271 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.231944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:46.240743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:46.242175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:46.243334 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e9dd24b4-dfde-4ad0-b922-ffd362695173 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.671982 Sep 26 01:38:46.243885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 158/317] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:45 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:46.261350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:46.261350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:46.268203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] validate_networks() for [('a09d4722-058c-40eb-9bf4-6c4a707b96c6', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:38:46.281874 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.282359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.282788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.283490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.284509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.285233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.639064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:46.650981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-396b7519-12f8-4d6b-8582-89a1420de5e5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.405985 Sep 26 01:38:46.665251 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 159/318] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:46 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:46.683374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:46.684332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:46.693802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.698133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.699468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.700533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.701185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.701845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.873279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:46.883175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f2634810-2b1f-4efb-a604-ac07bf5eeb38 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1272 microversion: 2.1 time: 0.215588 Sep 26 01:38:46.886962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 160/319] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:46 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:46.892417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:46.893455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:46.901574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.902292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.902884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:46.903812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:46.905190 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:46.905858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.194834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:38:47.196814 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:38:47.197585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:38:47.198164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:38:47.198990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:38:47.215453 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.216436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.217061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.218751 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.219363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.219952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.239594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.248945 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:38:47.250695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1b643eb1-3469-4e1b-8795-9cbe9dafedf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.362318 Sep 26 01:38:47.264829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Getting quotas for user fb54ba1355004e14b8dc43cf3c028e67 and project a553921e97994322b71fda7d032ed8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:38:47.266054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 161/320] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:46 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:47.277075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:47.277743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:47.280489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:38:47.283111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:38:47.284929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.285680 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.286300 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.287663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.288526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.289996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.308948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:47.371076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb76b357-b98c-41cd-9ae5-2ea1938e1959 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.535473 Sep 26 01:38:47.379503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 160/321] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:38:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 3537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:38:47.384711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ac1cf77-a020-49ba-9228-ad30de155092 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:47.385446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ac1cf77-a020-49ba-9228-ad30de155092 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:47.487442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ac1cf77-a020-49ba-9228-ad30de155092 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.504541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ac1cf77-a020-49ba-9228-ad30de155092 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1246 microversion: 2.1 time: 0.124435 Sep 26 01:38:47.505319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 161/322] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:47 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:47.606320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.621433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.622888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.624048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e7289108-1df6-4d7e-896c-ca725758ecb2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.351602 Sep 26 01:38:47.634327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 162/323] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:47 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:47.685864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:47.686468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:47.693015 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.693502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.693934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.694638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.695079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.695501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.884323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:47.893917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5edab584-edbf-4be9-b7d0-a82c185c1877 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.211110 Sep 26 01:38:47.894489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 162/324] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:47 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:47.913256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:47.913860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:47.920212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.921065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.921627 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:47.922460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:47.923022 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:47.923692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.070621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.079244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-00481e6c-564a-4162-994a-c2b584b51c70 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.170807 Sep 26 01:38:48.079813 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 163/325] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:47 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:48.277385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:48.278282 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:48.286575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.287219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.287837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.288595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.289047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.289472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.429581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.437363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d374131-d575-4030-a9ab-04670905f7ea tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.163868 Sep 26 01:38:48.437951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 163/326] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:48 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:48.527416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:48.528833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:48.536057 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.536596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.537039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.537745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.538201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.538626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.623633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.623633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6689cb9c-2b4b-4bdc-a4ce-6ae35f5bbd53 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1250 microversion: 2.1 time: 0.096520 Sep 26 01:38:48.623633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 164/327] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:48 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:48.659499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:48.660271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:48.666588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.667091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.667542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.668259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.668726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.669144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.824005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.833391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.835177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:48.836417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cec6395e-01f3-4d89-b64d-4a5512de8c9a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.181245 Sep 26 01:38:48.837273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 164/328] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:48 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:48.920711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:48.921469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:48.924063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:48.929716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.930319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.930753 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:48.931452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:48.931896 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:48.932314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.135514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:49.135514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:49.141830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.152681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.154096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.155104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.162569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.163399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.216173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:49.227591 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9bfa2bee-7a50-4c7f-b49b-d22a36e63c34 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.312716 Sep 26 01:38:49.232396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 165/329] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:48 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:49.268246 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3c7f9e-627e-471b-9262-606b432016bc", "name": "network-vif-unplugged", "status": "completed", "tag": "9b11200b-8c13-43fa-b896-2776db96c757"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:49.279771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.280275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.280740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.308035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] Creating event network-vif-unplugged:9b11200b-8c13-43fa-b896-2776db96c757 for instance 1c3c7f9e-627e-471b-9262-606b432016bc on hv-cinder-85920 Sep 26 01:38:49.313199 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-a7ba4204-486e-4b32-9530-3a27a9b29712 req-c8e41b34-fe58-4d34-964b-5cf12c90b7fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053105 Sep 26 01:38:49.313819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 166/330] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:38:49.365715 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:49.375065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3a817f6-1a77-4e76-ba8f-a4c7050550b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.273207 Sep 26 01:38:49.376150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 165/331] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:49 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:49.462155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:49.463037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:49.470124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.470124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.470502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.472147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.473416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.474284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.630913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:49.641823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6fc2267e-bf72-4399-b6ec-8cb6e002c292 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.183739 Sep 26 01:38:49.642974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 167/332] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:49 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:49.657153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:49.657815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:49.666740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.667231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.667670 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.668396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.668873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.669299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.751975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:49.761886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c60c1489-6088-4f8e-b78c-e7197e5ad95e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1250 microversion: 2.1 time: 0.122360 Sep 26 01:38:49.769907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 166/333] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:49 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1250 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:49.865472 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:49.865835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:49.872120 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.872952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.873679 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:49.874604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:49.875369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:49.875922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.033356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.042458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.043906 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.045331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2416005a-5349-4577-b3ca-264c7e3054ba tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.184737 Sep 26 01:38:50.045885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 168/334] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:49 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:50.255067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:50.256048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:50.262059 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.262782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.263382 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.264250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.264879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.265505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.399033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:50.399631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:50.405823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.406322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.406858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.407537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.407892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.408316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.408486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.421257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b41173e3-3ac2-48b6-aa29-f0e411fdb82d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.170053 Sep 26 01:38:50.436750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 167/335] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:50 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:50.555381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.563471 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8982f8eb-8720-49bd-bb9e-413a75a18465 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.168200 Sep 26 01:38:50.564214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 169/336] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:50 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:50.668560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:50.669174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:50.676696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.677457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.678152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.678971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.679529 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.680000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.703701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:50.786857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:50.787626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:50.804381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.804381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.804381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.804381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:50.804890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:50.805407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:50.812184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:50.841658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.850699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80e60bb3-6b6b-4e68-8d1a-5b7001db31ef tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.186011 Sep 26 01:38:50.851263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 168/337] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:50 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:50.887418 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:50.900503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fef5520c-7acc-4346-953a-b666b6555e5a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1250 microversion: 2.1 time: 0.118742 Sep 26 01:38:50.901204 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 170/338] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:50 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1250 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:51.076048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:51.076874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:51.083539 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.084236 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.084701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.085392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.085836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.086253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.264123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:51.288220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:51.289821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:51.291022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f90fdf5-902b-4124-b7b2-ed6fca78fe3f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.223276 Sep 26 01:38:51.291569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 169/339] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:51 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:51.458971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:51.459528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:51.466781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.467287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.467862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.468609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.469077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.469498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.491807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=4 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:51.589579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:51.592047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:51.599109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.599686 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.600796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.600999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.601532 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.602026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.623060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:51.636776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f51d1bfc-c7e4-4b85-ae5c-abee22d41a19 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.182586 Sep 26 01:38:51.637612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 171/340] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:51 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:51.768390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:51.776589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cfdb0a4-efb8-415d-81cf-2613c95bf04e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.193725 Sep 26 01:38:51.777466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 170/341] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:51 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:51.876652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:51.878018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:51.884450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.885081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.885617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.886412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.886973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.887503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.929341 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:51.930104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:51.936694 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.937492 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.938181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:51.939116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:51.939864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:51.940409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.032746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.048338 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c6f44a2-35c3-47c4-b129-38b0e13ceff5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1250 microversion: 2.1 time: 0.122720 Sep 26 01:38:52.049825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 171/342] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:51 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1250 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:52.072519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.080909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4a734365-dcd8-41d3-8f0d-9bfb24c11fda tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.209874 Sep 26 01:38:52.081790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 172/343] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:51 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:52.316718 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:52.317342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:52.329860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.330478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.340236 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.343274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.343810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.344253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.508810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.517450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.519918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.521104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-854c5c75-2db4-42c3-9a11-9a87f9f108a4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.208626 Sep 26 01:38:52.539946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 172/344] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:52 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:52.660291 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:52.661051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:52.668224 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.668994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.669431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.670301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.670926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.671478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.802426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:52.802997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:52.812335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.818801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.824004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a917d45a-e214-45ae-b9f5-57c34fb741d5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.167807 Sep 26 01:38:52.824597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.825907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.826724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:52.827495 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:52.828111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:52.838716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 173/345] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:52 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:52.986910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:52.994572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-894f5423-4865-4281-814c-53507a2465fa tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.196368 Sep 26 01:38:52.995138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 173/346] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:52 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:53.081407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:53.082354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:53.088876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.089366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.089801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.090503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.090959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.091384 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.106574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:53.107188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:53.115455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.115956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.116471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.117177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.117628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.118111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.157003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:53.167691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a17a9e11-9d5d-4f54-9cc5-d62b0f63698d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1250 microversion: 2.1 time: 0.093235 Sep 26 01:38:53.168288 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 174/347] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:53 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:53.257345 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:53.264920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-212d0544-c188-4b4d-a16f-4360f1b53b76 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.162413 Sep 26 01:38:53.265474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 174/348] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:53 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:53.546958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:53.547561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:53.554077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.554561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.554989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.555671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.556124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.556571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.724499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:53.732756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:53.736100 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:53.737367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-67dcac67-c28b-4190-b3f4-563441aebc88 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1740 microversion: 2.20 time: 0.194304 Sep 26 01:38:53.737924 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 175/349] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:53 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:53.850834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:53.851479 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:53.858189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.859949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.860424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:53.861133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:53.862138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:53.862668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.017996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:54.018727 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:54.025381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.025964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.026687 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.027590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.028233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.028901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.224523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:54.235184 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-feef231b-0686-47ce-871f-40b5e70adaf4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.390090 Sep 26 01:38:54.236635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 175/350] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:53 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:54.243069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:54.243833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:54.250530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.251281 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.251917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.253807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.254454 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.255128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.365857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:54.390829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5c48057-a59d-43b2-af5b-5ab587b2b3d0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1298 microversion: 2.1 time: 0.152299 Sep 26 01:38:54.391275 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 176/351] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:54 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:54.404602 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:54.404602 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:54.411630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.412719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.412719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.413258 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.414469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.414908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.465170 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:54.474002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1abdb44c-55d2-45e4-8410-873c684b6f9c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.459785 Sep 26 01:38:54.476788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 176/352] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:54 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:54.764786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:54.765313 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:54.772108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.772740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.773264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:54.774072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:54.774695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:54.775138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.121712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.132386 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf78e4fd-e53e-49a0-a440-c3ac95de4e45 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1513 microversion: 2.1 time: 0.737534 Sep 26 01:38:55.133635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 177/353] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:54 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1513 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:55.253002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.266235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:55.266703 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.268732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:55.270869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.272633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-587af826-b95e-475b-865c-70440876c99f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1722 microversion: 2.20 time: 0.512109 Sep 26 01:38:55.273884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 177/354] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:54 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:38:55.276579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.278070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.278631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.279469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.280275 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.280951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.417975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:55.418611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:55.430659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.431150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.431751 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.432685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.433266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.434049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.584965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.607447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e7ad29c3-da6c-430e-9d96-751d0247aa8e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1304 microversion: 2.1 time: 0.195231 Sep 26 01:38:55.608691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 178/355] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:55 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:55.614379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:55.615836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:55.645774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.646441 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.647497 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.648326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.648872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.650247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.753732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:55.781911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9de203ba-eb81-473c-8534-7b8d7c577fdc tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.522577 Sep 26 01:38:55.782797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 178/356] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:55 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:55.811881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3c7f9e-627e-471b-9262-606b432016bc", "name": "network-vif-deleted", "tag": "9b11200b-8c13-43fa-b896-2776db96c757"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:55.842584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:55.843094 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:55.843878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:55.881322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] Creating event network-vif-deleted:9b11200b-8c13-43fa-b896-2776db96c757 for instance 1c3c7f9e-627e-471b-9262-606b432016bc on hv-cinder-85920 Sep 26 01:38:55.906640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-41d79d9d-099d-4e7b-9f89-23a34f130096 req-51081749-4341-46cc-a74d-756d13bb5993 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118838 Sep 26 01:38:55.913387 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 179/357] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:56.160433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:56.161987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:56.169855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.170855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.171473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.173285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.173683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.174750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.222297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.223074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.223682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.224137 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'fault' on Instance uuid 1c3c7f9e-627e-471b-9262-606b432016bc {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:38:56.226580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.236013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-680d7be0-4017-4b53-9d5f-d2df62a763b0 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.625321 Sep 26 01:38:56.237953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 179/358] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:55 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:56.288229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.297939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f95f30e-d823-4b23-8866-594973dc2de4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1309 microversion: 2.1 time: 0.143734 Sep 26 01:38:56.297939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 180/359] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:56 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:56.304154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:56.304902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:56.311467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.312045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.312832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.313528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.313977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.314411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.453579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.464700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.466487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.467655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f04a5e60-c37f-4db5-8bca-c2077b76b986 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1722 microversion: 2.20 time: 0.168167 Sep 26 01:38:56.468210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 180/360] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:56 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:56.637560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:56.638177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:56.644575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.645065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.645500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.646188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.646644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.647159 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.652662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:56.663579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.664062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.664517 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.676211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] Creating event network-changed:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:38:56.681325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-5fb524a2-ff2c-4bd7-ad46-bbe182844af8 req-de65e4df-2f44-47c1-bbc0-bcd8957a8fae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032902 Sep 26 01:38:56.681928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 181/361] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:38:56.780489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.788853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e81a0e2b-8f5d-4db0-ae7a-d3158bf9f298 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.155215 Sep 26 01:38:56.789417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 181/362] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:56 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:56.807851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:56.808583 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:56.815168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.815851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.816280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.816985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:56.817433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:56.817857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:56.951115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:56.960821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-80f941f9-a27f-4fd9-aeb1-3167729cdd53 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.157504 Sep 26 01:38:56.961387 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 182/363] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:56 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:57.258260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "name": "network-vif-unplugged", "status": "completed", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:57.266195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:57.266851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:57.276504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:57.282014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.282642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.283283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.284178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.284768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.285422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.285605 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.286472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.287094 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.302687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] Creating event network-vif-unplugged:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:38:57.308967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5cf3d12f-c817-444e-a6a4-ab4354c8621c req-8d030b9b-f3f2-411a-a18f-aae6b6cafbf9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054105 Sep 26 01:38:57.310240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 182/364] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:57.322846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:57.323815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:57.333132 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.333619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.334055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.334763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.335218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.335678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.367864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.368576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.369183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.369631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'fault' on Instance uuid 1c3c7f9e-627e-471b-9262-606b432016bc {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:38:57.421372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.429002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a178c21b-0ffc-4b11-8532-f66041ef85f3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 200 len: 1309 microversion: 2.1 time: 0.111914 Sep 26 01:38:57.429573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 183/365] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:57 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:57.448711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.457124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0c9e93c0-96ea-4c57-a160-ba937c8f76da tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.195666 Sep 26 01:38:57.457684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 183/366] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:57 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:57.493511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:57.494125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:57.496076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:57.502129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.502628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.503069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.503767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.504228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.504685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.632553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.640625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.642077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.643735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1966e4b-39ef-4cdd-8ee3-145591afcaae tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1722 microversion: 2.20 time: 0.154145 Sep 26 01:38:57.644285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 184/367] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:57 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:57.812250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:57.812909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:57.819728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.820210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.820676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.821616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.822066 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.822487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.954724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d837132a-710f-45a8-8a44-38f2b04a09c8", "tag": "71029362-7449-46f9-acdd-1d08c343bce0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:57.959487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:57.964579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.965063 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.965489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.967297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f8edfc74-edb7-47a8-a27b-655ea177ff8a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.158823 Sep 26 01:38:57.967933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 184/368] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:57 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:57.976932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] Creating event network-changed:71029362-7449-46f9-acdd-1d08c343bce0 for instance d837132a-710f-45a8-8a44-38f2b04a09c8 on hv-cinder-85920 Sep 26 01:38:57.982372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9f27d8a2-0ba7-441c-a182-6fc8df4c8582 req-b1c08255-7207-4c90-bf14-55277a2ec0be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031313 Sep 26 01:38:57.984523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:57.985385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:57.986844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 185/369] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:38:57.992206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.992847 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.993229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:57.993923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:57.994376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:57.994793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.150192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:58.161195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-91a62ff1-1d3e-43dd-a29f-05603e363927 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.180737 Sep 26 01:38:58.177427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 185/370] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:57 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:58.331225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1921535419", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1697878717", "security_groups": [{"name": "tempest-secgroup-smoke-789307550"}], "networks": [{"uuid": "cbb874d2-1095-44b3-8932-a4b0bcc9e4a4"}], "block_device_mapping_v2": [{"uuid": "e4642695-91e0-403a-8f7b-6ea29e100d5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:58.459593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:58.460565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 1c3c7f9e-627e-471b-9262-606b432016bc] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:58.468493 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.469593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.470342 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.472128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.472886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.473426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.490866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] HTTP exception thrown: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Request method failure captured: Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc HTTP/1.1 Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQJRo86FnTiaz9slN9orsfsoDBlgTZSYG1c27W5o5svQNEqUdeKZBo9C-KeC5honHdWoqDEOkYP8-Lz89EES3l3YcJuuOnUgd1oZdcQ4-kC2Ck_RzYNVy3w8IcdUkgmt8BOmQQP9XTvJss4xfX3R-QG_LY0ykVLwEpoAtthdRFKRlmM Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: db1abf10c3e24836a161f3035d7e58ca Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:38:58.493261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db1abf10c3e24836a161f3035d7e58ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: db1abf10c3e24836a161f3035d7e58ca Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesSnapshotTestJSON-2030948517-project Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 44d8acef214449a085a2173930bb3ab1 Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesSnapshotTestJSON-2030948517-project Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. Sep 26 01:38:58.494588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '1c3c7f9e-627e-471b-9262-606b432016bc'} Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:38:58.495370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. Sep 26 01:38:58.496767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:38:58.499070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] validate_networks() for [('cbb874d2-1095-44b3-8932-a4b0bcc9e4a4', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:38:58.499999 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Returning 404 to user: Instance 1c3c7f9e-627e-471b-9262-606b432016bc could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:38:58.501121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0c34fa4e-e170-4812-ba94-75c8be96249a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc" status: 404 len: 111 microversion: 2.1 time: 0.050942 Sep 26 01:38:58.502616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 186/371] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:58 2022] GET /compute/v2.1/servers/1c3c7f9e-627e-471b-9262-606b432016bc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:38:58.520293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:58.524397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:58.531284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.531962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.532589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.534066 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.534681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.535260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.727612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:58.736777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-22c82a6c-d89a-4e78-8a69-3de886921773 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.232151 Sep 26 01:38:58.737630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 187/372] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:58 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:58.744382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:58.744382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:58.749523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.750015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.750452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.751212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.751943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.752390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.756768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:58.972780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:58.980780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:58.982240 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:58.983414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3de62171-bcdb-416d-bdc7-79781c5912ad tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1725 microversion: 2.20 time: 0.244807 Sep 26 01:38:58.983957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 188/373] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:58 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:38:58.991254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:58.991851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:58.997721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.998197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:58.998621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:58.999299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:58.999748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.000166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.081711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:38:59.082156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:38:59.082622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:38:59.083022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:38:59.083427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:38:59.092178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.092688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.093117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.093832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.094279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.094694 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.112308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Getting quotas for project d1d406b57f894053834ce17fa63fa6ac. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:38:59.116263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Getting quotas for user 5c72b19a91804de398c476c5e1c404cf and project d1d406b57f894053834ce17fa63fa6ac. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:38:59.147458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:59.155426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-358e9349-5773-47d1-8ceb-eacd4c84a01d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.168523 Sep 26 01:38:59.156074 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 189/374] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:58 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:38:59.161421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf0853bc-0bc2-45e7-9cdd-c4288c822bfb"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:59.163832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.169791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.170378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.170926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.171713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.172323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.172959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.175430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:38:59.177691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4642695-91e0-403a-8f7b-6ea29e100d5f',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:38:59.322598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2aac365e-64e6-4c68-8a61-6cd82d97da40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996858 Sep 26 01:38:59.323243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 186/375] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:38:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:38:59.333190 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:59.333797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.343291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.344020 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.344643 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.346296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.347200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.347798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.353730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:38:59.539427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:59.549418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-baef4be0-7703-4bd3-95ce-dbea151bb730 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.224465 Sep 26 01:38:59.550646 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 187/376] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:59 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:59.556387 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79a80650-f265-4ea2-8ad0-03cd060923fd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:59.557142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-79a80650-f265-4ea2-8ad0-03cd060923fd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.565206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-61c3f3cd-e056-4c9a-b7fb-889af8a677eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.407222 Sep 26 01:38:59.567770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 190/377] 10.222.0.25 () {62 vars in 1364 bytes} [Mon Sep 26 01:38:59 2022] POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments => generated 188 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:38:59.627913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-79a80650-f265-4ea2-8ad0-03cd060923fd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:59.638261 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79a80650-f265-4ea2-8ad0-03cd060923fd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1089 microversion: 2.1 time: 0.086258 Sep 26 01:38:59.638912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 188/378] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:59 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:38:59.718202 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:38:59.719796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.728602 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.729307 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.729983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.730833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.731883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.732926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.760996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:59.762175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.774553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.775773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.777276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.778436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.779441 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.780461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.785372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127126) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 01:38:59.890966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7ea114a0-de8c-4014-95ad-e03b036d252f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/action" status: 202 len: 0 microversion: 2.20 time: 0.176774 Sep 26 01:38:59.891820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 191/379] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Sep 26 01:38:59 2022] POST /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:38:59.902010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:38:59.902817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:38:59.911727 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.912415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.913013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.914230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:38:59.915565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:38:59.916269 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:38:59.954543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:38:59.963433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aad89060-87cf-495c-9ea9-5c5ce3752f06 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.208123 Sep 26 01:38:59.964042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 189/380] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:38:59 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:00.068740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.093828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.097475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.099050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0d8cfc81-2c65-467f-8399-e396e74e4c24 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1811 microversion: 2.20 time: 0.202058 Sep 26 01:39:00.099611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 192/381] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:38:59 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1811 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:00.180881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:00.181496 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:00.188252 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.189008 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.190209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.190980 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.191439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.191868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.341065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.351447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5f655a0-e37c-464b-ab9a-0aec6b11441e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.175143 Sep 26 01:39:00.352902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 190/382] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:00 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:00.581741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:00.582413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:00.589122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.589886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.590528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.591315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.591828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.592500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.662348 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:00.663235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:00.670626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.671365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.672374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.673121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.674130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.674563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.773502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.775575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:00.782908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61e9bf2b-229c-4609-8373-a8458b364c17 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1139 microversion: 2.1 time: 0.124724 Sep 26 01:39:00.795766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-054c6b4f-3f66-4ef1-8ef8-40f35580099c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.211129 Sep 26 01:39:00.795766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 193/383] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:00 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:00.796628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 191/384] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:00 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1139 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:00.989537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:00.990179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:00.996517 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.997010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.997478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:00.998334 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:00.999079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:00.999525 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.126114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:01.127555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:01.133731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.134456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.135070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.135931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.136572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.137325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.158345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.167854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b9df1733-722d-4d86-9c6b-74aa10917830 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.183295 Sep 26 01:39:01.169164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 194/385] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:00 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:01.297896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.316217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.318515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.319687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-349c8670-1044-4244-ad14-8537eaea0467 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1811 microversion: 2.20 time: 0.197714 Sep 26 01:39:01.320238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 192/386] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:01 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:01.375890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:01.376579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:01.383322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.383813 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.384249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.384979 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.385435 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.385862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.518490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.525960 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2d99962c-05de-4d18-a592-f856c6f85e2a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.154721 Sep 26 01:39:01.526535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 195/387] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:01 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:01.808897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:01.810041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:01.817850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.818333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.818759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.818857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:01.819449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.819760 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:01.819896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.820313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.826943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.827548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.846815 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.847810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:01.848586 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:01.849400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:01.915114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:01.925976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f432503e-5ead-439e-aca2-70e9c32f025e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1139 microversion: 2.1 time: 0.120917 Sep 26 01:39:01.926551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 193/388] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:01 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1139 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:02.158648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.169261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9dd83f34-f511-4bbb-8dfb-c583f204a3a9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1724 microversion: 2.1 time: 0.360571 Sep 26 01:39:02.170086 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 196/389] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:01 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:02.194309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:02.194974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:02.201490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.202093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.202519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.203209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.203708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.204286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.348695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:02.349567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:02.364496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.365005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.365451 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.366474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.366923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.367532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.546318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.567135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2bfd6465-280d-4315-af2b-0176d65717d4 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.377811 Sep 26 01:39:02.568151 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 194/390] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:02 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:02.575798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:02.576799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:02.588309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.590597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.591413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.592459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.593143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.593908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.665870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.685047 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.686562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.687763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-710082fe-7e99-4a69-87fc-cdc8ccd0fccf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1811 microversion: 2.20 time: 0.344624 Sep 26 01:39:02.688680 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 197/391] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:02 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1811 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:02.853051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:02.861533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9eb582a1-7f76-495c-8769-e6f51aefd0be tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.291257 Sep 26 01:39:02.862113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 195/392] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:02 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:02.955977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:02.956624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:02.962690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.963312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.963749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:02.964505 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:02.964960 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:02.969479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.035405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.043084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1553ac20-14fd-4d56-922d-7e16fce53d5e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.090907 Sep 26 01:39:03.043655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 198/393] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:02 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:03.195304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:03.196279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:03.202168 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.202656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.203091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.203779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.204229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.204767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.342419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.350489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d7a3990-ac0f-417a-91f1-567f7910af3d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1701 microversion: 2.1 time: 0.159004 Sep 26 01:39:03.351050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 196/394] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:03 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:03.372728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:03.379133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.379601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.380065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.402180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Going to try to start instance {{(pid=127126) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 01:39:03.441774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8b918d5c-9807-4ac5-bcd0-6f4db9fda20c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action" status: 202 len: 0 microversion: 2.1 time: 0.072658 Sep 26 01:39:03.442365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 199/395] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:39:03 2022] POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:39:03.450785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:03.451394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:03.453289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:03.459612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.460100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.460571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.461266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.461720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.462147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.590559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.591795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:03.592621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:03.598723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.598888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5ad7542-34bc-49d8-a5be-1bfa0330eb33 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.151890 Sep 26 01:39:03.599212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.599462 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 197/396] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:03 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:03.599653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.600362 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.600833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.601284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.604045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:03.717876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:03.718485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:03.724591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.725080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.725515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.726204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.726654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.727073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.739975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.747629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6fc105cf-de65-4184-b2e8-fde41e8dffbe tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.160380 Sep 26 01:39:03.748194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 200/397] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:03 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:03.858304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.867395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.868867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:03.870010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20e37714-e439-4ae0-8921-eb1fc53a6a14 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.156177 Sep 26 01:39:03.870567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 198/398] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:03 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:03.884106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:03.884744 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:03.890598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.891102 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.891531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:03.892430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:03.893148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:03.893574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.026244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:04.034641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6e8dfd6e-120d-42fe-889f-fd96758b3d74 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.154486 Sep 26 01:39:04.035236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 201/399] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:03 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:04.066696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:04.067303 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:04.073524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.074010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.074447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.075135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.075588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.076013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.138450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:04.146624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-166dd2a5-3010-4b62-b061-9a7067e08c01 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.083944 Sep 26 01:39:04.147191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 199/400] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:04 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:04.622746 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:04.623385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:04.629285 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.629775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.630209 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.630896 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.631345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.631767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.760392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:04.769321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1fd95ccc-929e-4eab-ae3d-c5966a54c96c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.150327 Sep 26 01:39:04.769905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 202/401] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:04 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:04.771538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:04.772138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:04.779522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.780036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.780570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.781323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.781767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.782203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.897628 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:04.898227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:04.904073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.904586 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.905018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.905701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:04.906164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:04.906580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:04.913064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:04.920591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad157242-93c7-4c15-9eb7-ee94e24ef84c tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.153509 Sep 26 01:39:04.921149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 200/402] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:04 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:05.035464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:05.043931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:05.045384 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:05.046535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-67598dcb-531b-447b-8d68-e7b60e251920 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.152960 Sep 26 01:39:05.047096 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 203/403] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:04 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:05.057764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:05.058368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:05.064233 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.064836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.065273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.065948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.066486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.066977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.169463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:05.170314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:05.176356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.176850 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.177284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.177977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.178428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.178852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.198550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:05.206891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e5b2531-4b57-4928-a451-beb5faf304a2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.152891 Sep 26 01:39:05.207455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 201/404] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:05 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:05.242130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:05.249735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-995cad11-a09c-4c34-b0fd-eac2d9429abf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.084093 Sep 26 01:39:05.250301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 204/405] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:05 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:05.794829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:05.795665 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:05.804276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.804808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.805301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.806030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.806483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.806913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.943356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:05.944636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:05.951318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.951805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.952233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:05.952955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:05.953402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:05.953819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.215999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.223308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.226940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1812f65-e0fd-4594-9e28-65b8c0da3ce1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.437664 Sep 26 01:39:06.227519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 202/406] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:05 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:06.231303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-96c7bec2-b00a-48fd-84b8-342428c820db tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.291894 Sep 26 01:39:06.231869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 205/407] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:05 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:06.231986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:06.232776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:06.236879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:06.237658 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:06.240749 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.241302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.241809 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.242641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.243211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.243713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.244621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.245112 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.245551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.246247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.246708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.247133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.440558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.448628 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.449584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.451029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.452183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0dd42aa1-3a91-4f23-a60c-bcc36bac5f98 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.223729 Sep 26 01:39:06.452771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 203/408] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:06 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:06.457894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:06.458482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:06.459779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f35c800a-433a-4e55-8e35-f58625bb0e9a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.226595 Sep 26 01:39:06.460851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 206/409] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:06 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:06.464892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.465429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.465988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.466785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:06.467374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:06.467897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:06.532493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:06.534693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:06.541459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd1881dd-a6d0-4c86-9618-7e9906d39f59 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.087676 Sep 26 01:39:06.542017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 204/410] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:06 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:07.249962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:07.250554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:07.253692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:07.254301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:07.257158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.257635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.258062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.258747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.259192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.259606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.260656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.261142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.261574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.262263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.262712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.263134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.453136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.457277 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.460789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-decbfdde-49fe-415a-bdea-3dea15e50a01 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.210783 Sep 26 01:39:07.461355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 205/411] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:07 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:07.465427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-204e78dc-b89c-420d-aa8b-7beb4d08e8c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.219277 Sep 26 01:39:07.465984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 207/412] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:07 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:07.478099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:07.478912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:07.482857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:07.483457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:07.484842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.485329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.486390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.487138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.487590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.488010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.489953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.490442 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.490910 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.491597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.492052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.492521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.682318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.686246 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.691603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.693291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.694649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1a5c8e62-2389-465e-b448-e659c0c37c12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.215641 Sep 26 01:39:07.694858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f0d28a5a-0599-4906-a88a-89d39227ef83 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.220394 Sep 26 01:39:07.695219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 208/413] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:07 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:07.696397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 206/414] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:07 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:07.700094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:07.700719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:07.707065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.707526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.707974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.708669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:07.709122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:07.709545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:07.773395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:07.780873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ef2a8b43-2815-4536-9217-6b403daf32ed tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.084453 Sep 26 01:39:07.781440 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 209/415] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:07 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:08.483512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:08.483988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:08.489867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:08.490745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.491048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:08.491244 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.491856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.492761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.493377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.493807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.497924 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.498430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.498894 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.499824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.500309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.500826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.701747 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.705675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.709912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90bc2f6c-7a1c-470e-a782-0d78029d66f5 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.230746 Sep 26 01:39:08.710482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 207/416] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:08 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:08.714397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0984b499-ac28-4321-bbf1-aa36dec77c5f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.229042 Sep 26 01:39:08.724600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 210/417] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:08 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:08.724789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d837132a-710f-45a8-8a44-38f2b04a09c8", "name": "network-vif-plugged", "status": "completed", "tag": "71029362-7449-46f9-acdd-1d08c343bce0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:08.724902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:08.724902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:08.728847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.728847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.728847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.729161 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.729161 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.729161 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.729914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.730245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.730661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.739222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] Creating event network-vif-plugged:71029362-7449-46f9-acdd-1d08c343bce0 for instance d837132a-710f-45a8-8a44-38f2b04a09c8 on hv-cinder-85920 Sep 26 01:39:08.744162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e6c85f12-5c99-4723-9bf8-87a45d457138 req-03e99b95-d488-475a-a13a-8b2bb7832f91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032585 Sep 26 01:39:08.744786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 208/418] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:08.749852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:08.750545 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:08.756546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.757187 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.757634 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.758330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.758786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.759213 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.917498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.925501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8b7c993b-3b33-49d9-b5c3-8738944d67a6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.208046 Sep 26 01:39:08.926163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 211/419] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:08 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:08.930684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:08.931387 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:08.934087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:08.937632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.938127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.938558 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.939465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:08.939835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.940102 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:08.940723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:08.950096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.951588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:08.952812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ee21f48-66e6-4bd5-a231-1dad556126b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.206969 Sep 26 01:39:08.953376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 209/420] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:08 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:09.010114 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:09.018799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-78530889-9aa3-45bf-a141-80299674c7a0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.091630 Sep 26 01:39:09.019458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:08 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:09.541366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-292608618", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "networks": [{"uuid": "d96ae2dd-c483-48c7-84c1-82589adaae3c"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:09.549918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:09.595595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] validate_networks() for [('d96ae2dd-c483-48c7-84c1-82589adaae3c', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:39:09.633394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:09.733459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:09.734166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:09.742111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:09.742596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:09.743019 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:09.743707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:09.744184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:09.744635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:09.980497 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:09.988752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fe45c570-5e6f-425c-82ef-c476cd0964cd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.259195 Sep 26 01:39:09.989559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 213/422] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:09 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:09.999898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:10.000532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:10.007294 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.007780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.008211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.008930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.009386 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.009808 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.025654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:39:10.026083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:39:10.026582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:39:10.026991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:39:10.027407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:39:10.038475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.038968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.039411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.040146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.040627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.041286 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.062952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Getting quotas for project db1abf10c3e24836a161f3035d7e58ca. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:39:10.067068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Getting quotas for user 44d8acef214449a085a2173930bb3ab1 and project db1abf10c3e24836a161f3035d7e58ca. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:39:10.078659 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:39:10.081230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:39:10.131699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d769492e-2e07-4a1f-aee6-64479cb23602 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594104 Sep 26 01:39:10.138564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 210/423] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:39:10.142240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:10.143038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:10.151276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.151712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.152259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.152868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.153326 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.153806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.155089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.173898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1b956134-b2db-46f0-b609-92cac811d3f5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.182471 Sep 26 01:39:10.174634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 214/424] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:09 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:10.195263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:10.196241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:10.202200 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.202692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.203124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.204036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.204535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.204963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.351843 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.361070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9182f1aa-ab80-44cd-8899-db04c7cf2a9d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.226819 Sep 26 01:39:10.362394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 211/425] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:10 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:10.379800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.383052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:10.383661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:10.390140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.390905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.391392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.392563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.392693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.393491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:10.393985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:10.394462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d15d440c-09fc-48e0-bfd4-99b44c66612b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.208102 Sep 26 01:39:10.394648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:10.395039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 215/426] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:10 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:10.400200 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bc75f765-0375-4bf9-9e55-42573417459c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:10.400857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bc75f765-0375-4bf9-9e55-42573417459c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:10.458804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bc75f765-0375-4bf9-9e55-42573417459c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.466848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bc75f765-0375-4bf9-9e55-42573417459c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1218 microversion: 2.1 time: 0.070667 Sep 26 01:39:10.467691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 216/427] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:10 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:10.486558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:10.494203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed141f2f-9c75-4a6f-9739-4ec0716c820c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.114882 Sep 26 01:39:10.494769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 212/428] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:10 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:11.012137 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.012765 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.019922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.020432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.020860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.021537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.022014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.022431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.150264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.152439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:11.159127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-39f30eb7-fe80-460c-a257-8f44176df522 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.150750 Sep 26 01:39:11.159690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 217/429] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:11.201511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.202122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.209073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.209556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.210001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.210686 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.211133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.211558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.343241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.352094 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08f3a75e-8ad3-4e1a-9e12-f79afcc97832 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.154356 Sep 26 01:39:11.352688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 213/430] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:11.385333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.385957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.391703 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.392182 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.392721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.393464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.393912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.394329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.420807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.421940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.430157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.430664 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.431174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.432181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.432400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.432834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.591477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.599321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-cc86c3d6-034a-4fd0-aac5-1f05f38809b1 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.218036 Sep 26 01:39:11.614656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 218/431] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:11.618773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.619902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.620686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.627986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.627986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.628428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.629208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.629663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.630110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.630252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.631752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.633047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f2eece0-b5c2-4e89-ad99-e6344d6fb1bf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.216070 Sep 26 01:39:11.633886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 214/432] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:11.657219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:11.657965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:11.664719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.665304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.665796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.666603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:11.667122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:11.667626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:11.699591 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.708551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e8720986-1b18-4346-8f28-359e7008e3d6 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1222 microversion: 2.1 time: 0.092247 Sep 26 01:39:11.709515 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 219/433] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:11.738147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:11.746461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf10e760-5615-4221-b9b0-93496cd24055 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1187 microversion: 2.1 time: 0.100658 Sep 26 01:39:11.748041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 215/434] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:11 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:12.183340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.183991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.203740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.205618 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.208788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.212175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.213685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.214841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.375807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.376726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.390409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.393801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.395991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.399802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.400547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.401328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.661131 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.668854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8decaf6d-43fc-4cef-95b8-6695f95792fc tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.489763 Sep 26 01:39:12.669415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 220/435] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:12.672188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.674722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.675407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.681910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca91e590-998a-4f05-8886-bcfe27fc3ec1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.309985 Sep 26 01:39:12.688530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 216/436] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:12.688530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.688530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.690996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.691494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.691928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.692670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.693283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.693709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.695067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.695884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.696402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.697270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.697723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.699603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.885703 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.889509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.894115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-adbf1604-e10a-435f-82f4-f454fdbfb51e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.223398 Sep 26 01:39:12.894690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 221/437] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:12.899084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.899686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.903800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.905403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.905538 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.905898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.906336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.906781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af7b0bea-0b14-4aac-a354-8a7a6a6fede0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.223094 Sep 26 01:39:12.907027 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.907486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.907595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 217/438] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:12.908024 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.913059 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:12.913602 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:12.919387 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.919975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.920518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.921293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:12.921810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:12.922449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:12.974250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:12.981879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4ace6ce6-e1b6-4d39-a1ea-7e74670d0a08 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1214 microversion: 2.1 time: 0.086208 Sep 26 01:39:12.982460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 222/439] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:12.999708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:13.008107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3127315d-92ac-421b-8374-7d6cf5e1927e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1205 microversion: 2.1 time: 0.098799 Sep 26 01:39:13.008719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 218/440] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:12 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:13.693007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:13.693611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:13.700321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.700849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.701284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.701971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.702419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.702837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.705852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:13.706469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:13.712902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.713380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.713804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.714487 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.714933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.715349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.900318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:13.906932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:13.908299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d92d2545-0e90-4350-841e-e8ea9f715687 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.219679 Sep 26 01:39:13.908924 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 223/441] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:13 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:13.915410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-934017fc-f35c-413e-a7ee-7aaac09bc106 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.213636 Sep 26 01:39:13.916092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 219/442] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:13 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:13.919949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:13.919949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:13.923877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.924389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.924825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.925509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.925960 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.926380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.935026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:13.935656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:13.942176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.942658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.943157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:13.943780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:13.944226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:13.944703 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.130380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.133269 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.138018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-25a0c9a0-8643-454b-8f9a-7457795c2758 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.224094 Sep 26 01:39:14.138589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 224/443] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:13 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:14.142005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.143941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:14.144064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.144574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:14.145195 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dcb31810-7be1-41d5-a4e6-10627c711f27 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.215244 Sep 26 01:39:14.147332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 220/444] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:13 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:14.150418 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.150908 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.151344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.152033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.152373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:14.152634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.153062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.153670 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:14.160896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.161380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.161812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.162500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.162953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.163374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.221962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.229490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3d6ec20c-0836-4541-9f46-32994b9685bf tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1214 microversion: 2.1 time: 0.089955 Sep 26 01:39:14.230054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 225/445] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:14 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:14.237595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:14.245361 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cfeba747-952d-4d27-bd7d-dba09757d79f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1205 microversion: 2.1 time: 0.098260 Sep 26 01:39:14.245944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 221/446] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:14 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1205 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:14.930963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:14.931561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:14.938145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.938622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.938822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:14.939283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.939501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:14.939777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.940378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.940807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.946543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.947021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.947451 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:14.948167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:14.948638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:14.949061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.151312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.154456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.156878 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:15.160467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6773caae-8f2d-470c-bfdf-d3d84922f066 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.233218 Sep 26 01:39:15.161223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 226/447] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:14 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:15.165573 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:15.165714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c26e3356-978a-4416-8d0f-5c0cd90d3add tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.230522 Sep 26 01:39:15.174470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:15.174710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 222/448] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:14 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:15.174807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.174807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.174807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.174807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.175175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.175175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.179712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:15.180311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:15.186792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.187181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.187640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.188328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.188816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.189514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.564950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.573997 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-13b56b5c-d5f8-4f6e-b8bf-bf3e2383e970 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.411925 Sep 26 01:39:15.578399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 227/449] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:15 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:15.580475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.583706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:15.584315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:15.593622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.594127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.594555 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.595110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.595557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.597053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.597053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.597809 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.598996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c27d19ee-6caa-4bcb-adf6-76b6eff6a414 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.423560 Sep 26 01:39:15.601577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 223/450] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:15 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:15.606607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:15.607277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:15.613766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.614319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.615001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.615855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.616373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.616980 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.706337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.707287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:15.715248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75e1455f-e03a-4b01-b5df-5f6f9b167ee2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1205 microversion: 2.1 time: 0.112239 Sep 26 01:39:15.715424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-126b7c06-ea7a-45f5-af7b-231b0aa472ca tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1270 microversion: 2.1 time: 0.135693 Sep 26 01:39:15.722690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 228/451] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:15 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:15.722690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "name": "network-vif-plugged", "status": "completed", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:15.722991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 224/452] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:15 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1205 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:15.731181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:15.731653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:15.732078 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:15.743777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] Creating event network-vif-plugged:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:39:15.749005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-218733f9-5adf-449e-92f9-69fff89d9a52 req-5e87a7c7-221c-4fe5-a558-f09d4260e1a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Sep 26 01:39:15.749650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 229/453] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:16.184801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:16.185553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:16.192593 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.193065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:16.193769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.193769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.194047 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:16.194967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.194967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.201156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.212591 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.217618 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.219139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.221845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.222780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.225438 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.663546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:16.672713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bf311ca1-41d4-464d-b98c-a44a4bf3f3af tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1710 microversion: 2.1 time: 0.485277 Sep 26 01:39:16.674508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 230/454] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:16 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1710 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:16.683197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:16.690300 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:16.693999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e65e464-ec9b-4fbd-b46f-ba7d87aa9286 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1314 microversion: 2.1 time: 0.513281 Sep 26 01:39:16.695688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 225/455] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:16 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:16.700328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:16.701544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:16.702735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:16.710246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.710810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.711317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.712321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.712897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.713412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.715804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.716296 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.716759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:16.717453 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:16.717899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:16.718315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.097740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.105939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3d33775d-57fd-4e77-9fbc-fcabbe6ffa7f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.430153 Sep 26 01:39:17.106516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 231/456] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:16 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:17.113454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:17.114729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:17.117384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.121865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.123182 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.123663 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.124672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.125181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.125613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.133412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.136542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.137744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3300ea70-a160-49b2-bf95-c40df30be78e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.440729 Sep 26 01:39:17.143608 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 226/457] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:16 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:17.149105 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:17.154447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:17.162846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.163334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.163846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.164512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.165190 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.166005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.223135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.233798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f45a1d44-4176-47fa-8543-c6f783063141 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1193 microversion: 2.1 time: 0.124654 Sep 26 01:39:17.233798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 232/458] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:17 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:17.291833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:17.299454 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-74f69991-7eef-43e8-9e10-d747b8af11ce tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1270 microversion: 2.1 time: 0.154474 Sep 26 01:39:17.300026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 227/459] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:17 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:17.699664 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:17.700324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:17.718728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:17.719676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.719885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:17.720250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.721933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.722191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.722647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.723580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.730580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.731417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.732092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:17.733197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:17.734043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:17.734929 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.060606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.069020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bf0f4ed1-e787-4a48-9e3c-3ba65cace80f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1714 microversion: 2.1 time: 0.373929 Sep 26 01:39:18.069594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 233/460] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:17 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1714 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:18.083561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.092845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2caeec1f-8341-441b-8463-316e489ce4b1 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1498 microversion: 2.1 time: 0.379361 Sep 26 01:39:18.093683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 228/461] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:17 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:18.130697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.131787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.140180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.140843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.141341 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.143085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.143742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.144917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.168511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.169212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.175734 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.176245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.176692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.177404 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.177858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.178285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.562127 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.566714 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.576260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.578315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.579975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-724edfbe-a448-4876-9437-cb81eaac73b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1372 microversion: 2.1 time: 0.453406 Sep 26 01:39:18.580369 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f315f16a-77ea-4cb6-80af-74ba1a18b4b9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1753 microversion: 2.20 time: 0.415483 Sep 26 01:39:18.582186 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 229/462] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:18 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1753 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:18.586373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 234/463] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:18 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1372 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:18.589030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.589948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.593828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.596467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.599249 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.601521 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.602889 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.603894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.605769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.607999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.621756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.623022 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.629582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.631344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.644371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.645848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.695208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:18.789955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.797890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6d2c6843-c4a7-44bc-b67a-34cf15bd5fa3 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1270 microversion: 2.1 time: 0.210464 Sep 26 01:39:18.798545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 235/464] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:18 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:18.803180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.803778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.809527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.810018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.810448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.811145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.811593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.812015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.838259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:39:18.903212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:18.911622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88878737-06f8-48d2-96d1-726ae39a9efb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.327422 Sep 26 01:39:18.912200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 230/465] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:18 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:18.920338 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7e51c4d2-a5e0-46d5-a4cc-3a8ad011bf87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 204 len: 0 microversion: 2.1 time: 0.120126 Sep 26 01:39:18.921276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 236/466] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:39:18 2022] DELETE /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:39:18.929317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:18.930215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:18.935991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.936550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.936998 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.937690 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:18.938147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:18.938574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:18.995642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891098ae-6262-467f-814b-d930d1540931", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:19.007261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.007752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.008283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.021630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] Creating event network-changed:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:39:19.026351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-91365a7b-e73b-43e9-85ab-052c61db99c7 req-195c24b8-d01d-43a2-9c3e-4d771129a925 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Sep 26 01:39:19.026956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 237/467] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:19.216978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.235145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0c6368b-dd6b-49ba-8c94-84dc0f18ff57 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1504 microversion: 2.1 time: 0.309603 Sep 26 01:39:19.235735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 231/468] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:18 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:19.645787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:19.646881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:19.647421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:19.648239 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:19.653861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.654335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.654777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.655477 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.655875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.656006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.656377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.656806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.657247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.658026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.658534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.658966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.854859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.863549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6068e505-a847-472e-bb08-cad094ae0135 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1565 microversion: 2.1 time: 0.222448 Sep 26 01:39:19.864114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 232/469] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:19 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:19.868845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:19.869723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:19.874841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.876015 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.877390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.878402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.880676 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.881362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.882033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.885532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.887875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.888142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b1a23cac-9bbf-4b8e-9916-43a453e24606 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.246983 Sep 26 01:39:19.889101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 238/470] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:19 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:19.894742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:19.895223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:19.901430 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.902071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.902579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.903377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.903901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.904443 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.962072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:19.969629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e82e58b0-1be2-4c58-98cb-abcb19465b40 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1276 microversion: 2.1 time: 0.104203 Sep 26 01:39:19.970235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 233/471] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:19 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:19.974824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:19.975420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:19.981329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.981815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.982251 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.983053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:19.983515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:19.983934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:19.997591 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4804a080-148b-451a-b83e-417e36ffc810 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107234 Sep 26 01:39:19.998184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 239/472] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:39:19 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:20.048859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:20.074061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:20.259390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:20.260054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:20.266293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:20.266794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:20.267230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:20.267947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:20.268420 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:20.268847 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:20.463794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:20.559731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:20.571193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7878e68a-6661-4cdf-b7b8-e1eb7621126d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.599708 Sep 26 01:39:20.572027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 234/473] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:19 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:20.787820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:20.795791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d721830a-94ff-472b-b926-b67facb562c6 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1504 microversion: 2.1 time: 0.540381 Sep 26 01:39:20.796608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 240/474] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:20 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:20.916330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:20.917610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:20.927009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:20.927967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:20.928702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:20.929427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:20.929890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:20.930469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:20.994509 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:20.994857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:21.002844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.003419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.004041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:21.004826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.005272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.005915 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:21.241938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:21.249525 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fc7296a9-d0b4-4e07-af49-5389e679cd3b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1276 microversion: 2.1 time: 0.260119 Sep 26 01:39:21.250090 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 241/475] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:20 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:21.597476 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:21.598075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:21.603904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.604417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.604845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:21.605527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.605972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.606420 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:21.650119 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:21.660360 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:21.661829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:21.663191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5a5f301-5d13-4d9b-9108-4dcee8dd39c4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.751607 Sep 26 01:39:21.663742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 235/476] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:20 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:21.821463 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:21.822103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:21.828664 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.830696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.831359 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:21.832616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:21.833346 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:21.833992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:22.426365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:22.434953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c05d7a2a-902e-4555-a3ab-a63ed7f409ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.841577 Sep 26 01:39:22.435837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 242/477] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:21 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:22.441282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:22.442118 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:22.448904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:22.449397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:22.449824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:22.450532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:22.450977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:22.451580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:22.495609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:22.506372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4cb439f8-6e56-4582-bc3a-15b6f4e0c4b7 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1504 microversion: 2.1 time: 0.689926 Sep 26 01:39:22.522075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 236/478] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:21 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1504 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:22.662159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:22.673007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-79ace5cf-7215-439c-adb6-293732943fbc tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1276 microversion: 2.1 time: 0.235674 Sep 26 01:39:22.696592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 243/479] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:22 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:22.707536 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:22.708153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:22.716917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:22.717414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:22.717842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:22.718738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:22.719269 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:22.719615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.288243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:23.298212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:23.300407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:23.301737 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0d32d1a-3cdb-4a21-9ce8-df2a6f2a4cf2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.599585 Sep 26 01:39:23.302406 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 237/480] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:22 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:23.380129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d837132a-710f-45a8-8a44-38f2b04a09c8", "name": "network-vif-deleted", "tag": "71029362-7449-46f9-acdd-1d08c343bce0"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:23.401210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.402949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.406290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.429029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] Creating event network-vif-deleted:71029362-7449-46f9-acdd-1d08c343bce0 for instance d837132a-710f-45a8-8a44-38f2b04a09c8 on hv-cinder-85920 Sep 26 01:39:23.436236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-18971ceb-4e0d-4ab0-a369-90080ffc02c1 req-382ee470-9172-44e1-b3ad-644948b2bb14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063874 Sep 26 01:39:23.437321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 244/481] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:23.459371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:23.460017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:23.472049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.472615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.472934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.473657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.474099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.474552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.538320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:23.539932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:23.560094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.562747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.567362 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.568362 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.569203 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.569810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.650157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.650908 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.651565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.652298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:23.784684 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:23.796185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f3f6c2fa-5b92-4286-bf76-b5b95bb6e388 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.266636 Sep 26 01:39:23.798061 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 245/482] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:23 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:23.825758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:23.840193 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:23.856022 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.857932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.858925 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:23.861137 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:23.863645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:23.864740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.040039 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:24.053392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd90cca2-a767-4ecb-ab3a-a6ec07391269 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.598336 Sep 26 01:39:24.056451 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 238/483] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:23 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:24.224085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:24.232174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c9656891-3b9f-4bc0-99cd-00d66081d8ec tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.431572 Sep 26 01:39:24.235643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 246/484] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:23 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:24.333397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:24.334360 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:24.347250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:24.347746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:24.356971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.357825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:24.358250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:24.358688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.382425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:24.827810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:24.828467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:24.835402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:24.836130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:24.836767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.837743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:24.838358 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:24.838957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.865437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:24.883591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:24.885418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:24.889172 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:24.890836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:24.892226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:24.892629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f2925c6-3c79-4dfb-939c-91aeeeb16a52 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.567280 Sep 26 01:39:24.893374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:24.910164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 239/485] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:24 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:24.990527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:25.007823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5f2ab7bd-2f53-4829-9a64-a72b6b36200e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.189351 Sep 26 01:39:25.008801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 247/486] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:24 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:25.077822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:25.078465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:25.080698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:25.104847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.106240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.106240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.107072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.107627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.108305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.259845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:25.260584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:25.270897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.271398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.271832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.272581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.273033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.273455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.482017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:25.492731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7d48583-b055-4f7d-a9e5-238bf5fcf546 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.419420 Sep 26 01:39:25.496585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 240/487] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:25 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:25.501575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:25.511853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.512863 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.514308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.555043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] Creating event network-changed:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:39:25.561215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6aeb7adf-0a3c-4ba1-8c20-a2268fc03472 req-98ff8c50-b2e3-4a2a-9172-fdc4097783e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062930 Sep 26 01:39:25.562432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 241/488] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:25.699782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:25.716969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d382bc4a-07d2-4e78-ace7-cc4a7e1d2c4b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.458412 Sep 26 01:39:25.719955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 248/489] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:25 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:25.930959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:25.931795 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:25.938841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.939892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.940420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:25.941201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:25.941723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:25.942207 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.033445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:26.035136 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:26.043251 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.044132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.044858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.046434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.047088 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.047719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.097039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.097431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.097858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.098294 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:26.115902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.125536 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.128014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.129242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-321821a3-00da-424e-b628-b190ec53ad89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.202943 Sep 26 01:39:26.140370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 242/490] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:25 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:26.154258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.164897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a52b1dcd-cb73-4fbc-a78b-4b836c879f0b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.135813 Sep 26 01:39:26.165477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 249/491] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:26 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:26.518905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:26.519649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:26.527012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.527012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.527653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.528435 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.528967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.529676 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.679697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.687570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22555b75-279c-4ef3-8a92-194e1bdc5255 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.172574 Sep 26 01:39:26.688139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 243/492] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:26 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:26.740993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:26.741608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:26.748134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.748913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.749513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.750401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:26.750856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:26.751496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:26.930627 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:26.933319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:26.942922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b4ade6c4-6daf-41b8-b5f9-8e9259e3ca0a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.205524 Sep 26 01:39:26.944588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 250/493] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:26 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:27.162879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:27.163536 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:27.169519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.170017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.170453 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.171150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.171602 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.172025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.188976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:27.189791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:27.197252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.197837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.198349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.199250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.199784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.200566 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.242886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.243408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.243867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.248189 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:27.302704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:27.312481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2bf7aa78-2616-43b0-8c8b-9251d51a8901 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.127577 Sep 26 01:39:27.313247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 251/494] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:27 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:27.345766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:27.354563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:27.356353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:27.357991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a77ccfd6-5d15-40d0-a715-9462964f1c0a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.199138 Sep 26 01:39:27.359154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 244/495] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:27 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:27.588662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6255eb-07ec-489b-b2e2-14156cb19a01", "tag": "b3409e03-5d08-4a6c-857e-a3f8f740ae98"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:27.599328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.599886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.600316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.611629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] Creating event network-changed:b3409e03-5d08-4a6c-857e-a3f8f740ae98 for instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 on hv-cinder-85920 Sep 26 01:39:27.616488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-8f9ea7dd-f125-41ff-a547-4ac973a381c8 req-b3c9953f-714a-4ff4-809a-bf2c27d9e5fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031654 Sep 26 01:39:27.617101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 252/496] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:27.711532 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:27.712130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:27.718684 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.719164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.719614 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.721418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.721934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.722292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.880024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:27.887990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c77e6c7-b9be-426d-aaa0-1db2176dd698 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.180195 Sep 26 01:39:27.888588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 245/497] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:27 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:27.966596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:27.967284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:27.973752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.974236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.974662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:27.975355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:27.975799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:27.976217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.122354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:28.131048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5e1d93ad-0dcf-49b5-a4ae-6b5d002aeaf4 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.168450 Sep 26 01:39:28.138812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 253/498] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:27 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:28.335650 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:28.336257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:28.342481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.342959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.343386 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.344070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.344544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.345634 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.381328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.382046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.382478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.382958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:28.385173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:28.386242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:28.392932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:28.394400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.394962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.395531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.396238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.396803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.397317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.433140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:28.447904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2771708e-346f-4ba4-9d4c-b51762e29254 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.115488 Sep 26 01:39:28.448753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 246/499] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:28 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:28.576717 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:28.586303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:28.587854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:28.589201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-17bbe5b1-4589-437b-9609-690a597142ea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.208485 Sep 26 01:39:28.590069 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 254/500] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:28 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:28.914229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:28.914841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:28.923649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.924173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.925296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:28.926048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:28.926668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:28.927250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.084121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.092644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c781c3f-0b0d-4c65-84da-bb69963e9ae6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.182320 Sep 26 01:39:29.093554 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 247/501] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:28 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:29.154662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:29.155276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:29.162569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.163059 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.163494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.164218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.164883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.165599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.347831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.361757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bb56b10b-809b-449f-bb27-e0ae0826f293 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.209906 Sep 26 01:39:29.362959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 255/502] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:29 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:29.473641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:29.474364 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:29.491574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.492146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.492552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.493276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.493738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.494169 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.544223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.544816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.545259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.545708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:29.590827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.600106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-601691b6-a16b-4ffc-b07c-412a5175f0bb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.130974 Sep 26 01:39:29.600714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 248/503] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:29 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:29.617147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:29.617744 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:29.624321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.624838 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.625272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.626027 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:29.626614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:29.627039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:29.819888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.832870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.834392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:29.835646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2214d77d-6266-4235-958b-f31462790e7b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.222547 Sep 26 01:39:29.836656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 256/504] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:29 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:30.121971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:30.122574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:30.130025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.130508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.130938 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.131630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.132077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.132523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.276629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:30.285250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cccc845c-5a69-470c-8cfe-65b5a410568f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.167069 Sep 26 01:39:30.285830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 249/505] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:30 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:30.389034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:30.389652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:30.396610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.397108 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.397547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.398246 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.398705 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.399129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.535194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:30.543173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e8445dc4-70b2-4e4f-bf05-0bf89413a8c1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.157903 Sep 26 01:39:30.543743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 257/506] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:30 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:30.623341 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:30.623953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:30.634845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.635750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.636841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.637877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.638549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.639329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.673651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.674239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.674740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.675259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:30.720374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:30.729556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-129173a5-035d-4f1e-a6b2-f94773bcd28b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.110090 Sep 26 01:39:30.732462 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 250/507] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:30 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:30.861849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:30.863083 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:30.871424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.871829 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.872477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:30.873185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:30.873635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:30.874055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.019295 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.033249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.034968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.036424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9eb5dbff-d9c5-43fb-9d49-044008c21bee tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.179454 Sep 26 01:39:31.052369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 258/508] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:30 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:31.310939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:31.311548 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:31.323537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.324028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.324489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.325200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.325652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.326073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.477138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.486990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5f2414f-1dc3-4e2f-b8e8-50fabee71881 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.180286 Sep 26 01:39:31.487605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 251/509] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:31 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:31.566603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:31.567125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:31.573530 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.574118 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.574537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.575229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.575861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.576278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.716790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.726125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f7b5378d-df7b-493f-98f3-abd9e4e95bb8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.163479 Sep 26 01:39:31.726694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 259/510] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:31 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:31.753371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:31.753986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:31.759958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.760478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.760920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.761611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.762069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.762496 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.796332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:31.796845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:31.797284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:31.798371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:31.838172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:31.846291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-13463296-3f7a-4149-9a4c-bc922e402ae9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.097072 Sep 26 01:39:31.846850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 252/511] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:31 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:32.062775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:32.063437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:32.069757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.070507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.070942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.071631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.072081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.072609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.200471 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:32.210208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:32.212436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:32.214555 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-62a98afa-ee05-4520-b6da-a43581311667 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.155446 Sep 26 01:39:32.215606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 260/512] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:32 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:32.510442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:32.511053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:32.518036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.518522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.518959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.519647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.520102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.520563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.648315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:32.656018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecbc2b8f-b6ef-4fcb-95a2-ab08b26fb475 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.149807 Sep 26 01:39:32.656615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 253/513] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:32 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:32.749219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:32.749962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:32.755962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.756480 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.756913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.757599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.758051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.758470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.869450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:32.870051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:32.876119 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.876639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.877074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.877774 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.878222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.878647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.891079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:32.899662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8d66c358-8dd9-4810-b63c-7f3e21ebc704 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.154219 Sep 26 01:39:32.900331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 261/514] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:32 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:32.916088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:32.916088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:32.916088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:32.916088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid d837132a-710f-45a8-8a44-38f2b04a09c8 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:33.040117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:33.050272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cff64c32-b27e-403b-9d31-b2b000ea5c7a tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 200 len: 1304 microversion: 2.1 time: 0.182192 Sep 26 01:39:33.051367 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 254/515] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:32 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:33.242345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:33.242942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:33.249448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.249931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.250392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:33.251469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.251929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.252403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:33.551149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:33.559819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:33.561366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:33.562529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-79426602-ea0c-4bfe-b06a-066c5d9a20f8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.324014 Sep 26 01:39:33.563091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 262/516] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:33 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:33.679986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:33.680716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:33.687220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.687790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.688431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:33.689415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.689865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.690311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:33.693021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:33.924229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:33.924764 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:33.931403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.931403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.931666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:33.932363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:33.932823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:33.933235 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.000023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.008523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7dc358b8-6ad0-4e6f-a2b7-2b06e4189326 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.332289 Sep 26 01:39:34.009169 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 255/517] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:33 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:34.073872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:34.074577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: d837132a-710f-45a8-8a44-38f2b04a09c8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:34.080637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.081129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.081567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.082489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.082952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.083382 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.097356 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] HTTP exception thrown: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Request method failure captured: Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 HTTP/1.1 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQKe_IlfwMqVHG8okTsfHbUSwQfX6k8K-fDdh8-yQMAbI5PsSqqQx8-S6y66JhI2UFfZMZyqXVs26_K_t5kxl0lwteXAc5eOs20osUKo4PtL8M1OXHTBg0KrujPpXfzPvRS3hs4XKXDyut99amIfdmjMJN3FYbznIS4cQdyjqGUjcfM Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 3d84eb826e054de3a831769967d5ed91 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesActionsTest-8589532 Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:39:34.099013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d84eb826e054de3a831769967d5ed91", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesActionsTest-8589532 Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 3d84eb826e054de3a831769967d5ed91 Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesActionsTest-8589532 Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesActionsTest-8589532-project Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: af260a85502047dc960f8ed19df299d6 Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesActionsTest-8589532-project Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. Sep 26 01:39:34.100652 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'd837132a-710f-45a8-8a44-38f2b04a09c8'} Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:39:34.101537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. Sep 26 01:39:34.102997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:39:34.104333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Returning 404 to user: Instance d837132a-710f-45a8-8a44-38f2b04a09c8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:39:34.104333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6827f6c-37c7-466b-9695-ae149ed2725f tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8" status: 404 len: 111 microversion: 2.1 time: 0.030703 Sep 26 01:39:34.104333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 256/518] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:34 2022] GET /compute/v2.1/servers/d837132a-710f-45a8-8a44-38f2b04a09c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:39:34.187175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.195659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-19ccbb89-df94-439f-9458-6bd0737d6657 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.276027 Sep 26 01:39:34.196318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 263/519] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:33 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:34.223420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1529821308", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "networks": [{"uuid": "03bf27a4-e655-4790-88ee-39ba306a1cc8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:34.281491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] validate_networks() for [('03bf27a4-e655-4790-88ee-39ba306a1cc8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:39:34.590150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:34.590760 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:34.597226 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.597713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.598188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.598849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.599301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.599727 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.650199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:39:34.650692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:39:34.651237 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:39:34.651714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:39:34.652221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:39:34.663236 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.663806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.664304 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.665215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:34.665671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:34.666100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:34.683093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Getting quotas for project 3d84eb826e054de3a831769967d5ed91. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:39:34.687416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Getting quotas for user af260a85502047dc960f8ed19df299d6 and project 3d84eb826e054de3a831769967d5ed91. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:39:34.699831 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:39:34.702175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:39:34.744561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.753678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7574b8a8-7ffc-4dbd-b91e-d56d66d625fb tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534697 Sep 26 01:39:34.753883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.754322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 257/520] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:39:34.761390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.762583 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8b2f7407-8bc0-40f8-b02c-bee966b7e494 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.176375 Sep 26 01:39:34.763134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 264/521] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:34 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:34.765078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c4ae251f-39d7-481b-aae5-dc5a12ba1e03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:34.765699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c4ae251f-39d7-481b-aae5-dc5a12ba1e03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:34.823733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c4ae251f-39d7-481b-aae5-dc5a12ba1e03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:34.830864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c4ae251f-39d7-481b-aae5-dc5a12ba1e03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1214 microversion: 2.1 time: 0.069371 Sep 26 01:39:34.831440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 258/522] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:34 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:35.031381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:35.032270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:35.039134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.039885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.040405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.041132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.041584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.042010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.178981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.186674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c5caf82a-48f6-4cb2-b717-5c9e70b52643 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.159104 Sep 26 01:39:35.187241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 265/523] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:35 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:35.218940 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:35.219579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:35.225946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.226439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.226873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.227600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.228105 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.228577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.364332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.372398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4917df1-7545-4d82-b91f-f602ee2cce4f tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.157273 Sep 26 01:39:35.372973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 259/524] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:35 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:35.790016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:35.790649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:35.796934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.797450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.797987 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.798678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.799132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.799562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.853413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:35.853928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:35.860290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.860819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.861253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.861942 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:35.862386 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:35.862806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:35.940608 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.948388 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5848b75-cf91-40cc-acb8-a91df62083c2 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1266 microversion: 2.1 time: 0.098804 Sep 26 01:39:35.948951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 260/525] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:35 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:35.957470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.965870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.967304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:35.968489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-de3c784f-c5b4-42dc-8125-886e1f1d7d99 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.182418 Sep 26 01:39:35.969053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 266/526] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:35 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:36.210417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:36.211018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:36.217580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.218065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.218494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.219709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.220540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.220761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.395575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:36.396561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:36.402823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.403318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.403765 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.404498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.404963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.405390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.694678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:36.702759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edff58b2-7301-4df1-877c-7c55f0256217 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.496317 Sep 26 01:39:36.703321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 261/527] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:36 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:36.736415 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:36.738649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:36.745791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-620a1d47-f43e-4d45-ba68-a268833cde7a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.354515 Sep 26 01:39:36.746527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 267/528] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:36 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:36.971131 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:36.971769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:36.978129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.978620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.979049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.979739 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:36.980188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:36.980636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:36.994613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:36.995394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:37.003454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.004064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.004784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:37.005591 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.006152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.006682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:37.061128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:37.071032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-107eecbe-e95c-42e2-85a6-2753300788ea tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1272 microversion: 2.1 time: 0.103855 Sep 26 01:39:37.071601 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 262/529] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:36 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:37.246258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:37.256699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:37.258156 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:37.259520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-90b269b2-0d5d-4ad4-a087-0e2d0ad8fa89 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.268638 Sep 26 01:39:37.260080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 268/530] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:36 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:37.726360 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:37.726974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:37.732968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.733541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.734045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:37.735435 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.735982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.736540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:37.769639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:37.770242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:37.776188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.776963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.777686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:37.778468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:37.778963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:37.779572 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.015767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.024522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00c3b239-f43c-4e65-9421-1c0acb7567c2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.301986 Sep 26 01:39:38.025344 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 263/531] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:37 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:38.053311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.061694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-82acb6d3-f19f-40d1-9ce1-961f8922026c tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.296050 Sep 26 01:39:38.062311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 269/532] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:37 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:38.090026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc25fed5-bf7a-4502-8844-d4d5a8ef4878", "tag": "b81f1c72-abee-42c0-bea0-b8f720493f0c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:38.093745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:38.094614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:38.099831 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:38.100317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:38.100700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:38.100832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.101179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:38.101604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.102292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:38.102737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:38.103154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.112568 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] Creating event network-changed:b81f1c72-abee-42c0-bea0-b8f720493f0c for instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 on hv-cinder-85920 Sep 26 01:39:38.117485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8c475a51-fc57-4233-98a1-7ac0a65032ad req-3e7af169-0137-423d-96b4-787ac750741f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Sep 26 01:39:38.118271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 264/533] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:39:38.247371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.255807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-852e345d-08ab-42fa-a4a1-8deb1a387078 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.165897 Sep 26 01:39:38.256305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 270/534] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:38 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:38.286919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:38.287586 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:38.293781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:38.294259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:38.294691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.295364 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:38.295812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:38.296227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:38.425611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.434089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.435506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:38.436687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb11e899-e99a-44b2-8d6d-b6b922b76e6b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.154794 Sep 26 01:39:38.437245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 265/535] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:38 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:39.049205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:39.049846 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:39.056263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.056809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.057243 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.057940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.058382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.058803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.084866 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:39.085494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:39.091974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.092550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.093006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.093691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.094706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.095200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.244849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.253198 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f2933909-4546-4132-9c89-a4aece2a3467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.208618 Sep 26 01:39:39.253769 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 271/536] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:39 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:39.272818 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.277920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:39.278568 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:39.280330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77c01fc3-d523-406c-8bba-b225541e329b tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.199237 Sep 26 01:39:39.280925 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 266/537] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:39 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:39.285136 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.285622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.286057 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.286750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.287205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.287626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.418155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.426498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c7102905-9547-4850-9bb4-62b289b78669 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.152427 Sep 26 01:39:39.427069 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 272/538] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:39 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:39.463550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:39.464159 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:39.470817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.471314 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.471755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.472491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.472948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.473375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.560656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6255eb-07ec-489b-b2e2-14156cb19a01", "name": "network-vif-plugged", "status": "completed", "tag": "b3409e03-5d08-4a6c-857e-a3f8f740ae98"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:39.571250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:39.571726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:39.572153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:39.584194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] Creating event network-vif-plugged:b3409e03-5d08-4a6c-857e-a3f8f740ae98 for instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 on hv-cinder-85920 Sep 26 01:39:39.589518 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-4e4567fa-36ad-4d56-83ee-fadb1ace1554 req-a90b71b0-2b50-4606-bd14-9b1adc54b1df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037972 Sep 26 01:39:39.590124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 273/539] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:39:39.617331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.627412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.628891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:39.630074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-036d84a5-86ab-4832-82fe-2b1b307a8482 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.170570 Sep 26 01:39:39.630641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 267/540] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:39 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:40.278097 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:40.278801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:40.285774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.286259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.286693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.287376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.287827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.288249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.303971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:40.304612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:40.310966 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.311458 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.311897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.312616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.313077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.313502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.561249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.568644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.569678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f82ec41d-5325-4495-891f-12425fdd8478 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.296238 Sep 26 01:39:40.570495 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 274/541] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:40 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:40.574846 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:40.575441 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:40.577691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96ff6cd7-3f26-42de-bd26-9daef08c72db tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.277499 Sep 26 01:39:40.579077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 268/542] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:40 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:40.582235 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.582721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.583164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.583845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.584294 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.584734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.654970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:40.655595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:40.661732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.662210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.662642 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.663321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:40.663764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:40.664182 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:40.745429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.753205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b694e554-91b3-4795-bc04-c5935039cf3b tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.181738 Sep 26 01:39:40.753782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 275/543] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:40 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:40.807911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.816426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.817860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:40.819011 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88ec729a-2250-4760-9e5d-1928c54abd58 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.167914 Sep 26 01:39:40.819562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 269/544] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:40 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:41.601607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:41.602314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:41.602804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:41.603410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:41.611683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.611889 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.612193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.613004 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.613442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.613770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.614795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.615365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.615880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.616689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.618307 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.621010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.828416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:41.835701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:41.836420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5675d930-c73f-4230-8e08-2c27911feed1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.237334 Sep 26 01:39:41.836986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 270/545] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:41 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:41.842188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:41.842822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:41.844954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4d65860e-6cc9-4c4a-8c5e-227766308b28 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1318 microversion: 2.1 time: 0.247572 Sep 26 01:39:41.857017 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 276/546] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:41 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:41.857196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.857196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.857196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.857196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.857578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:41.857674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.857773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:41.857874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.860109 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.860727 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.861273 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:41.861957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:41.862413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:41.862836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:42.055993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:42.059197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:42.064222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3a9c81b-508f-4195-a395-7461dcc08534 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.226088 Sep 26 01:39:42.064821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 271/547] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:41 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:42.068633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:42.070408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:42.071634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d16309c1-0cf2-4aa0-94f4-91868a1b4ed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.225068 Sep 26 01:39:42.072279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 277/548] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:41 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:42.859091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:42.859792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:42.866540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:42.867041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:42.867482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:42.867988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:42.868410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:42.868622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:42.868744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:42.869057 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:42.874932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:42.875962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:42.876403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:42.877137 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:42.877582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:42.878004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.066682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.070629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.075257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18e396dd-0d9f-4913-a36a-71a5f38e7a67 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.220054 Sep 26 01:39:43.076022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 272/549] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:42 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:43.079096 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4c7737ad-a0b3-4ec2-9f82-b43e7c00c98a tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1506 microversion: 2.1 time: 0.214329 Sep 26 01:39:43.079740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 278/550] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:42 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:43.088905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:43.089512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:43.096605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.097100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.097540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.097797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:43.098272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.098401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:43.098730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.099162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.104141 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.104660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.105097 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.105784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.106237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.106658 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.293309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.297674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.301832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c80d784-afce-4753-95f6-a1a73083a517 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.216552 Sep 26 01:39:43.302513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 273/551] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:43 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:43.306697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.307060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "093dab0d-b36b-453c-ae06-3f0bdcaa2721", "device": "/dev/sdb"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:43.308140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:43.309324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e06432fa-3e30-4e93-aa26-20894229cbcd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.215834 Sep 26 01:39:43.310032 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 279/552] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:43 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:43.312457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:43.319146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.319952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.320562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.321257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.321708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.322129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.391490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:43.568802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-641ee86f-6d36-4c48-afe2-d92e1f0ef361 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "POST /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265036 Sep 26 01:39:43.570075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 274/553] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:39:43 2022] POST /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:43.715308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "name": "network-vif-plugged", "status": "completed", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:43.728026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:43.728617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:43.728955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:43.741824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] Creating event network-vif-plugged:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:39:43.746602 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-921222e0-4361-4411-9973-9f94838e3d29 req-5aa64b08-85af-4f9d-9658-aa9c92cbcb50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035414 Sep 26 01:39:43.747290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 280/554] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:39:44.101380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:44.102080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:44.108662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.109192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.109713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.110425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.110872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.111297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.259461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:44.269641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97525627-544d-43b6-81b7-95d3a017ccf3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.172312 Sep 26 01:39:44.270224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 275/555] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:44 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:44.327481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:44.329975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:44.335571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:44.336419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:44.337933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.338460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.339042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.339757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.340408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.340994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.343374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.344420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.345024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.346207 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:44.346666 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:44.347078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:44.562386 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:44.567208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:44.570912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-86967102-70cb-4688-884a-1678c8e4bf30 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.249044 Sep 26 01:39:44.571488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 281/556] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:44 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:44.576037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:44.577604 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:44.579748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a12dee38-8051-459c-bf7d-7612a71102e3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.247985 Sep 26 01:39:44.580385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 276/557] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:44 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:45.293653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:45.294252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:45.300474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.300996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.301434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.302151 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.302603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.303026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.441142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:45.451160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4453c09c-4316-458a-856e-2ac10830ace8 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.161170 Sep 26 01:39:45.452056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 282/558] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:45 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:45.595455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:45.596383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:45.603891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:45.606618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:45.609802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:45.610923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:45.613171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.614111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:45.614595 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.617038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.617849 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.618387 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.619674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.622947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.623520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.624208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.625643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.626303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.627411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.838522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:45.840916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:45.847005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e7b127c-5ff3-4ef6-844d-1d5991f7395d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.255779 Sep 26 01:39:45.847575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 277/559] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:45 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:45.852129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891098ae-6262-467f-814b-d930d1540931", "name": "network-vif-plugged", "status": "completed", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:45.861476 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:45.861657 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:45.862444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:45.862876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:45.864763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:45.866526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ed262ace-aac2-418f-a888-ed8a6e7275cc tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.263786 Sep 26 01:39:45.867325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 283/560] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:45 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:39:45.874527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] Creating event network-vif-plugged:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:39:45.880313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3b0b98ed-1926-4304-ac9c-038dc4f28129 req-58eefc52-e3b9-4a76-a89a-d15725ad2669 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031443 Sep 26 01:39:45.880929 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 278/561] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:46.474113 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:46.474848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:46.481510 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.482280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.483053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:46.483882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.485254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.485819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:46.692335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:46.702753 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9e96acb7-0755-4993-89cd-1b66feb59d3a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.232206 Sep 26 01:39:46.704157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 284/562] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:46 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:46.870890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:46.871722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:46.878422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.878907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.879342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:46.880031 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.880511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.880937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:46.894330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:46.894964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:46.900861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.901354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.901801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:46.902495 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:46.902947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:46.903367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:47.088833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:47.091899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:47.094923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:47.099678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89dc4c24-d4ac-4583-97ea-1d6495427e87 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.233472 Sep 26 01:39:47.100257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 279/563] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:46 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:47.104418 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:47.105843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:47.106990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f163ac04-9330-47e1-8beb-4dc3816992d8 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1809 microversion: 2.20 time: 0.217302 Sep 26 01:39:47.107544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 285/564] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:46 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:47.726102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:47.726713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:47.732650 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:47.733134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:47.733569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:47.734687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:47.735153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:47.735580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:47.869231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:47.877956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c1fc2bc-7afe-4d8a-bf1f-e0a661eab9b6 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1260 microversion: 2.1 time: 0.155701 Sep 26 01:39:47.878785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 280/565] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:47 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:47.894562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc25fed5-bf7a-4502-8844-d4d5a8ef4878", "name": "network-vif-plugged", "status": "completed", "tag": "b81f1c72-abee-42c0-bea0-b8f720493f0c"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:47.906038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:47.907337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:47.907843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:47.918934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] Creating event network-vif-plugged:b81f1c72-abee-42c0-bea0-b8f720493f0c for instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 on hv-cinder-85920 Sep 26 01:39:47.923640 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-48638575-c905-410b-a188-3a06435dfb6e req-63b56aeb-1b9c-4f3e-8029-7ab814009d93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033320 Sep 26 01:39:47.924225 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 286/566] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:48.122185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:48.122797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:48.129396 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.129886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.130324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:48.131017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.131473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.131903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:48.133735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:48.134428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:48.140501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.141479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.141919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:48.142607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.143064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.143486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:48.333762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:48.337784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:48.341477 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-509c40a1-eedc-426d-9b91-babb528afd6e tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.223102 Sep 26 01:39:48.342037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 281/567] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:48 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:48.347035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:48.348565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:48.349731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5f6c1793-925b-4b29-98ed-3f1af15d01f1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1796 microversion: 2.20 time: 0.220197 Sep 26 01:39:48.350286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 287/568] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:39:48 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1796 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:39:48.901821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:48.902426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:48.909253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.909733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.910170 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:48.910876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:48.911325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:48.911742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:49.044407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:49.052430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-669c21b7-6551-4165-8e95-c356d977576a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1444 microversion: 2.1 time: 0.154413 Sep 26 01:39:49.053010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 282/569] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:48 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:49.075370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:49.075986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:49.082934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:49.083424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:49.083865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:49.084588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:49.085044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:49.085470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:49.219596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:49.227317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-05c3e2a0-f910-4b95-9ac5-e97707ead2cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1444 microversion: 2.1 time: 0.155694 Sep 26 01:39:49.227868 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 288/570] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:49 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:49.365599 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:49.366314 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:49.372264 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:49.372840 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:49.373348 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:49.374092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:49.375448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:49.376333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:49.598551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:49.605970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef553a63-98a1-4b73-9448-2bea507c3fe9 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1314 microversion: 2.1 time: 0.244148 Sep 26 01:39:49.606527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 283/571] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:49 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:50.630165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:50.630788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:50.637377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:50.637862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:50.638300 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:50.639002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:50.639459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:50.639880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:50.870263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:50.878180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e74b1466-74df-4166-b692-f478db611d74 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1498 microversion: 2.1 time: 0.252244 Sep 26 01:39:50.879132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 289/572] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:50 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:51.369337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891098ae-6262-467f-814b-d930d1540931", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:51.380010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:51.380491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:51.380993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:51.394324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] Creating event network-changed:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:39:51.398302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-847e8044-159e-4b78-a623-dd94aa3d9e7b req-aed1c523-c4a2-485f-8e0e-e44aee3e1eb5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032674 Sep 26 01:39:51.399087 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 284/573] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:39:51.486395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:51.487330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:51.495392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:51.495876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:51.496303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:51.497081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:51.497529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:51.497942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:51.527361 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:39:51.643000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b1b5acdf-4101-4e23-9ced-b4b58af15b5d tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 204 len: 0 microversion: 2.1 time: 0.160800 Sep 26 01:39:51.644178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 290/574] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:39:51 2022] DELETE /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:39:51.654511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:51.655736 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:51.664247 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:51.664803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:51.665212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:51.666121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:51.666577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:51.667001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:51.809257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:51.817752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c71af3dd-1e63-4147-9c13-339f7ed5a025 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1504 microversion: 2.1 time: 0.168153 Sep 26 01:39:51.818316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 285/575] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:51 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:39:52.842080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:52.842686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:52.849802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:52.850279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:52.850704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:52.851382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:52.851827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:52.852242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:52.982152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:52.990256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3cbd9700-cd66-4790-9ccc-685dcdfd7f10 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1504 microversion: 2.1 time: 0.152511 Sep 26 01:39:52.990823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 291/576] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:52 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:54.013961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:54.014514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:54.021706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:54.022192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:54.022627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:54.023318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:54.023771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:54.024197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:54.157484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:54.165146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2ef2b017-4ae2-4b02-a0dc-ee8d96d19d03 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1504 microversion: 2.1 time: 0.155179 Sep 26 01:39:54.165696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 286/577] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:54 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:55.188620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:55.189224 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:55.195895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:55.196407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:55.196847 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:55.197531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:55.197984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:55.198403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:55.326200 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:55.334529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3e32435d-6387-4f90-add5-6a4d26746606 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1504 microversion: 2.1 time: 0.149883 Sep 26 01:39:55.335090 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 292/578] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:55 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:56.358533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:56.359989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:56.366472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:56.366960 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:56.367394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:56.368121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:56.368603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:56.369036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:56.573600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:56.594467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48fb3525-1e03-4faf-a850-b43c4b058a77 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1504 microversion: 2.1 time: 0.239733 Sep 26 01:39:56.595228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 287/579] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:56 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:56.784487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc25fed5-bf7a-4502-8844-d4d5a8ef4878", "name": "network-vif-deleted", "tag": "b81f1c72-abee-42c0-bea0-b8f720493f0c"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:39:56.795051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:56.795789 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:56.796949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:56.808580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] Creating event network-vif-deleted:b81f1c72-abee-42c0-bea0-b8f720493f0c for instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 on hv-cinder-85920 Sep 26 01:39:56.813560 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-7cc8aa42-bb1d-4782-9617-68a24684110b req-655f4e0a-c4de-444f-b48e-9bec8dd19b06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Sep 26 01:39:56.814146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 293/580] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:39:57.617482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:57.618088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:57.624525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:57.625012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:57.626093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:57.626636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:57.627082 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:57.627503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:57.658948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:57.659420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:57.659852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:57.660291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid fc25fed5-bf7a-4502-8844-d4d5a8ef4878 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:57.703257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:57.711513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c8d2178-9786-44d9-b223-1b0aff3fd9dd tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1304 microversion: 2.1 time: 0.097915 Sep 26 01:39:57.712073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 288/581] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:57 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:58.735350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:58.736037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:58.737972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:39:58.743324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:58.743800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:58.744227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:58.744936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:58.745378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:58.745793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:58.778000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:58.778540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:58.779126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:58.779595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid fc25fed5-bf7a-4502-8844-d4d5a8ef4878 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:58.822376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:58.830127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a4408d69-80e6-4abe-b5f9-975f055714cf tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1304 microversion: 2.1 time: 0.099552 Sep 26 01:39:58.830685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 294/582] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:58 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:39:59.852780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:39:59.853383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:39:59.860583 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:59.861188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:59.861624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:59.862305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:59.862750 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:59.863167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:59.895443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:39:59.895932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:39:59.896399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:39:59.896841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lazy-loading 'fault' on Instance uuid fc25fed5-bf7a-4502-8844-d4d5a8ef4878 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:39:59.938738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af260a85502047dc960f8ed19df299d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d84eb826e054de3a831769967d5ed91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:39:59.946526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-49ead6f1-1ebe-4667-8e3b-fe5ff2edde31 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 200 len: 1304 microversion: 2.1 time: 0.097507 Sep 26 01:39:59.947091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 289/583] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:39:59 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:00.970230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:00.970821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] [instance: fc25fed5-bf7a-4502-8844-d4d5a8ef4878] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:00.977934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:00.978414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:00.979011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:00.979865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:00.980446 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:00.980869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:00.993958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] HTTP exception thrown: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Request method failure captured: Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 HTTP/1.1 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQKe_IlfwMqVHG8okTsfHbUSwQfX6k8K-fDdh8-yQMAbI5PsSqqQx8-S6y66JhI2UFfZMZyqXVs26_K_t5kxl0lwteXAc5eOs20osUKo4PtL8M1OXHTBg0KrujPpXfzPvRS3hs4XKXDyut99amIfdmjMJN3FYbznIS4cQdyjqGUjcfM Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 3d84eb826e054de3a831769967d5ed91 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesActionsTest-8589532 Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:40:00.995565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d84eb826e054de3a831769967d5ed91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d84eb826e054de3a831769967d5ed91", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesActionsTest-8589532 Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 3d84eb826e054de3a831769967d5ed91 Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesActionsTest-8589532 Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesActionsTest-8589532-project Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: af260a85502047dc960f8ed19df299d6 Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesActionsTest-8589532-project Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. Sep 26 01:40:00.997187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'fc25fed5-bf7a-4502-8844-d4d5a8ef4878'} Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:40:00.998011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. Sep 26 01:40:00.999489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:40:01.000821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] Returning 404 to user: Instance fc25fed5-bf7a-4502-8844-d4d5a8ef4878 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:40:01.000821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fe4f9a65-35e0-41c5-8856-fe74a9a4d656 tempest-VolumesActionsTest-8589532 tempest-VolumesActionsTest-8589532-project] 10.222.0.25 "GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878" status: 404 len: 111 microversion: 2.1 time: 0.032124 Sep 26 01:40:01.000821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 295/584] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:00 2022] GET /compute/v2.1/servers/fc25fed5-bf7a-4502-8844-d4d5a8ef4878 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:40:07.150371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:07.151257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:07.163632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:07.164881 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:07.165542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:07.166527 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:07.167146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:07.167692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:07.344673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:07.358103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'services' on Instance uuid 0b6255eb-07ec-489b-b2e2-14156cb19a01 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:07.538025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8cc82e6-dde0-4442-9a46-9715ddec3622 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01/os-volume_attachments/093dab0d-b36b-453c-ae06-3f0bdcaa2721" status: 202 len: 0 microversion: 2.1 time: 0.392314 Sep 26 01:40:07.539107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 290/585] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:40:07 2022] DELETE /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01/os-volume_attachments/093dab0d-b36b-453c-ae06-3f0bdcaa2721 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:40:08.702567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:08.704451 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:08.711904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:08.712884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:08.713548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:08.714635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:08.715317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:08.715950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:08.746077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:40:08.832626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f9870599-684b-4321-b9d4-4dd99b07f8d8 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 204 len: 0 microversion: 2.1 time: 0.133680 Sep 26 01:40:08.833952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 296/586] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:40:08 2022] DELETE /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:40:08.844129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:08.845841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:08.857239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:08.861026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:08.861529 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:08.862569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:08.863423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:08.863869 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:09.016518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:09.028023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a428c1e1-4da2-463b-89e3-7e1c32a5640e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1512 microversion: 2.1 time: 0.188767 Sep 26 01:40:09.037457 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 291/587] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:08 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:10.059622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:10.060474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:10.068086 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:10.068635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:10.069330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:10.070070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:10.070490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:10.070919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:10.221658 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:10.232806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-67546fe9-53b9-4e74-8d5e-fde1aedee371 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1512 microversion: 2.1 time: 0.177816 Sep 26 01:40:10.233896 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 297/588] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:10 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:11.259075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:11.259786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:11.266728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:11.268909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:11.269365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:11.270102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:11.270561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:11.270993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:11.689252 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:11.698948 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-94d4e45f-41c9-4cc0-b176-ab9a034a9f59 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1512 microversion: 2.1 time: 0.443590 Sep 26 01:40:11.700171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 292/589] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:11 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:12.634545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6255eb-07ec-489b-b2e2-14156cb19a01", "name": "network-vif-deleted", "tag": "b3409e03-5d08-4a6c-857e-a3f8f740ae98"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:12.650633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:12.653452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:12.653452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:12.699892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] Creating event network-vif-deleted:b3409e03-5d08-4a6c-857e-a3f8f740ae98 for instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 on hv-cinder-85920 Sep 26 01:40:12.708565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-d3a27a23-2a22-4851-ad3e-09e8131715ee req-4c3f284f-8569-4cdd-8a16-0d38b9a8c50f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083624 Sep 26 01:40:12.711380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 298/590] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:40:12.731611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:12.732800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:12.744113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:12.749069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:12.752287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:12.753187 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:12.755876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:12.756585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:12.795627 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:12.796109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:12.797385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:12.797843 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'fault' on Instance uuid 0b6255eb-07ec-489b-b2e2-14156cb19a01 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:12.844713 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:12.853782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4cc6e0df-7901-4f74-aee8-f27045b66102 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1308 microversion: 2.1 time: 0.127303 Sep 26 01:40:12.874589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 293/591] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:12 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:13.882392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:13.883093 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:13.889682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:13.890490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:13.891372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:13.892216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:13.892791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:13.893416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:13.929341 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:13.930138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:13.930791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:13.931454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lazy-loading 'fault' on Instance uuid 0b6255eb-07ec-489b-b2e2-14156cb19a01 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:13.975807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d8acef214449a085a2173930bb3ab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1abf10c3e24836a161f3035d7e58ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:13.985049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8aaed91f-8373-4630-85eb-363725ce36d1 tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 200 len: 1308 microversion: 2.1 time: 0.107258 Sep 26 01:40:13.985820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 299/592] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:13 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:15.009528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:15.010268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] [instance: 0b6255eb-07ec-489b-b2e2-14156cb19a01] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:15.017910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:15.018410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:15.018852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:15.019570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:15.020029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:15.020501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:15.035990 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] HTTP exception thrown: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Request method failure captured: Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 HTTP/1.1 Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQJRo86FnTiaz9slN9orsfsoDBlgTZSYG1c27W5o5svQNEqUdeKZBo9C-KeC5honHdWoqDEOkYP8-Lz89EES3l3YcJuuOnUgd1oZdcQ4-kC2Ck_RzYNVy3w8IcdUkgmt8BOmQQP9XTvJss4xfX3R-QG_LY0ykVLwEpoAtthdRFKRlmM Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: db1abf10c3e24836a161f3035d7e58ca Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:40:15.037710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/db1abf10c3e24836a161f3035d7e58ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_db1abf10c3e24836a161f3035d7e58ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: db1abf10c3e24836a161f3035d7e58ca Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2030948517 Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesSnapshotTestJSON-2030948517-project Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 44d8acef214449a085a2173930bb3ab1 Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesSnapshotTestJSON-2030948517-project Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. Sep 26 01:40:15.039349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '0b6255eb-07ec-489b-b2e2-14156cb19a01'} Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:40:15.040785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. Sep 26 01:40:15.041947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:15.044199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] Returning 404 to user: Instance 0b6255eb-07ec-489b-b2e2-14156cb19a01 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:40:15.044199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-765fdacf-7543-4fff-ba6f-918c077d432e tempest-VolumesSnapshotTestJSON-2030948517 tempest-VolumesSnapshotTestJSON-2030948517-project] 10.222.0.25 "GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01" status: 404 len: 111 microversion: 2.1 time: 0.033678 Sep 26 01:40:15.044199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 294/593] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:15 2022] GET /compute/v2.1/servers/0b6255eb-07ec-489b-b2e2-14156cb19a01 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:40:23.398732 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:23.399427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:23.407449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:23.408003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:23.408532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:23.409288 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:23.409820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:23.410365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:23.413167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:23.508625 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lazy-loading 'services' on Instance uuid b84bc271-dfaf-4aac-9c18-29b9202eec84 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:23.591221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3520fc94-acef-4f8a-b6a2-b0e9b1fb593a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments/4a2fdfd2-6791-4e92-b71f-09e7980dd8b6" status: 202 len: 0 microversion: 2.1 time: 0.196114 Sep 26 01:40:23.592119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 300/594] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:40:23 2022] DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments/4a2fdfd2-6791-4e92-b71f-09e7980dd8b6 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:40:24.721802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:24.724044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=42 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:24.729204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:24.729687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:24.730120 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:24.792963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 01:40:24.837479 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0332bd60-5856-48ef-a12c-cecb9a411f81 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action" status: 202 len: 0 microversion: 2.1 time: 0.119521 Sep 26 01:40:24.838076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 295/595] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:40:24 2022] POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:40:24.849183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:24.850580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:24.857308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:24.857799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:24.858262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:24.859208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:24.859667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:24.860238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:25.005556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:25.014052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2a2f4b4c-2c78-4383-a6c5-bcbce021bf85 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.171316 Sep 26 01:40:25.014702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 301/596] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:24 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:26.039084 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:26.039781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:26.047858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:26.048782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:26.049239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:26.049939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:26.050388 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:26.051255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:26.194373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:26.202172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24a3f99c-6ce6-4974-a76a-91e4298cdda7 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.167397 Sep 26 01:40:26.202734 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 296/597] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:26 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:26.358317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a61f5f0d-04c8-4680-ba47-06afe4723899"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:26.361698 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:26.368434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:26.368920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:26.369355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:26.370046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:26.370494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:26.370912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:27.227692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:27.228298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:27.234717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:27.235202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:27.235637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:27.236324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:27.236798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:27.237221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:27.364681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:27.372210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4996608d-34e7-4006-80a7-cf708bde4267 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.148324 Sep 26 01:40:27.372798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 297/598] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:27 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:28.151390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-35273e05-b88e-4765-bad5-f9be0fc366ba tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.796874 Sep 26 01:40:28.152245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 302/599] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:40:26 2022] POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments => generated 194 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:40:28.396706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:28.397337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:28.403636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:28.404170 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:28.404632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:28.405317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:28.405764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:28.406185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:28.540725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:28.548833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0332b19f-242f-4b67-9dd6-1a2fdc324635 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.156099 Sep 26 01:40:28.549315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 298/600] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:28 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:29.574848 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:29.575665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:29.578010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:29.584923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:29.585539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:29.585985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:29.586692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:29.587159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:29.587596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:29.742959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:29.751257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a6e060a9-05d0-47aa-97ea-77e1a2f9e37a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.180812 Sep 26 01:40:29.751823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 303/601] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:29 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:30.775067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:30.775838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:30.783921 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:30.784470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:30.784907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:30.785610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:30.786068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:30.786692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:30.953043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:30.962061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4ef24de-0a69-4ea8-855c-ca375314aeeb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.190881 Sep 26 01:40:30.962993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 299/602] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:30 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:32.001154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:32.001773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:32.007979 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:32.008502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:32.008941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:32.009699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:32.010086 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:32.010513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:32.156206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:32.164493 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7d6b4056-8467-4b96-86ba-2e6ecd82863b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.167173 Sep 26 01:40:32.165054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 304/603] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:31 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:33.188837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:33.190255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:33.198118 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:33.198615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:33.199072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:33.200538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:33.201031 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:33.201436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:33.342515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:33.352322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-daae4b4f-0796-42f3-b691-8f84bbbcd00e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.167519 Sep 26 01:40:33.352907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 300/604] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:33 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:34.376619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:34.377366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:34.384224 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:34.384759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:34.385196 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:34.385914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:34.386381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:34.386810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:34.529316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:34.537925 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-80d249f7-5ba0-4da8-a859-166144109a00 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.165338 Sep 26 01:40:34.538494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 305/605] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:34 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:35.561493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:35.562104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:35.569669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.570152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.570589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:35.571279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.571729 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.572157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:35.708653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:35.716577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a737c90f-7119-4379-b900-469a2ff0e4e2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.158852 Sep 26 01:40:35.717229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 301/606] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:35 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:35.749597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:35.752087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:35.758461 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.758941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.759373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:35.760060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.760544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.760966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:35.784159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'flavor' on Instance uuid 5b15f03f-c129-4db7-a021-c160558dbecb {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:35.943280 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-45194031-1182-41d7-81a4-19f2816f3a3b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/action" status: 200 len: 32 microversion: 2.1 time: 0.197596 Sep 26 01:40:35.944149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 306/607] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:40:35 2022] POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 01:40:35.953563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:35.954170 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:35.960760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.961189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.961625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:35.962322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:35.963054 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:35.963481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:36.096821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:36.104958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a61a568-9176-40fa-a104-a6ff936fde71 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.155187 Sep 26 01:40:36.105516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 302/608] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:35 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:36.741340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:36.742039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:36.748058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:36.748590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:36.749027 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:36.749709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:36.750213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:36.750566 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:36.895084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:36.903306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d0c689ff-5a0f-4b0c-88c6-a215e4a26db9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.166362 Sep 26 01:40:36.903883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 307/609] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:36 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:37.128300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:37.128998 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:37.135822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:37.136242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:37.136710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:37.137391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:37.137838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:37.138262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:37.265411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:37.273872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18fa7db9-3252-45f6-99c4-74fa66ffc5d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.149878 Sep 26 01:40:37.274437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 303/610] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:37 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:37.926681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:37.927297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:37.935777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:37.936390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:37.936926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:37.938550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:37.939701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:37.940411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:38.151780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:38.159954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e6cde177-c657-487e-8a86-1acfda23fd77 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.237103 Sep 26 01:40:38.160542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:37 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:38.297771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:38.298415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:38.305905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:38.306426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:38.306868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:38.307567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:38.308051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:38.308530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:38.311401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:38.494146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:38.502817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3db7a580-e2e3-47e5-a14c-b6e979d171ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.208803 Sep 26 01:40:38.503395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 304/612] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:38 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:39.182825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:39.183436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:39.190609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.191099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.191566 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.192219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.192700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.193126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.330440 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:39.338169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-30056db0-771b-4775-bd02-58fc4e504665 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1678 microversion: 2.1 time: 0.159164 Sep 26 01:40:39.338734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 309/613] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:39 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:39.494099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:39.494667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:39.502405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.502786 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.503222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.503924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.504582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.505014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.531064 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:39.531904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:39.535038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-147ee54c-3291-4bd0-881f-b07f5f2da72d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments/bf0853bc-0bc2-45e7-9cdd-c4288c822bfb" status: 200 len: 194 microversion: 2.20 time: 0.044711 Sep 26 01:40:39.535638 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 305/614] 10.222.0.25 () {60 vars in 1454 bytes} [Mon Sep 26 01:40:39 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments/bf0853bc-0bc2-45e7-9cdd-c4288c822bfb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:40:39.539648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.540331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.540793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.541870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.542251 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.542693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.609706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:39.610330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:39.616785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.617339 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.618006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.618917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.619441 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.619987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.698169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:39.708716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4e76a546-3079-40e6-9b6e-94b1fbffa9b6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.183526 Sep 26 01:40:39.710304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 310/615] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:39 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:39.741416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'services' on Instance uuid 8390f758-83d5-4553-910b-5ec8bcb93ce6 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:39.816193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee9a7019-485e-414d-b920-8b079ee11c70 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments/bf0853bc-0bc2-45e7-9cdd-c4288c822bfb" status: 202 len: 0 microversion: 2.20 time: 0.210168 Sep 26 01:40:39.817055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 306/616] 10.222.0.25 () {60 vars in 1457 bytes} [Mon Sep 26 01:40:39 2022] DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments/bf0853bc-0bc2-45e7-9cdd-c4288c822bfb => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:40:39.825791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:39.828119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:39.834785 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.835343 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.835863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.836821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:39.837329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:39.837752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:39.873139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-08061050-ab40-4535-9f7f-29ed467f2f8a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050999 Sep 26 01:40:39.873764 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 311/617] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Sep 26 01:40:39 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:40:40.362209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:40.362902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:40.369358 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.369852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.370350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.371185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.371647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.372073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.515409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:40.523102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e495f31-a4ec-49ae-b00d-e25789cd2f11 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1655 microversion: 2.1 time: 0.165393 Sep 26 01:40:40.523654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 307/618] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:40 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:40.545306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:40.552372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.552865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.553299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.576209 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Going to try to start instance {{(pid=127126) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 01:40:40.582063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:40.622320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7f50da6e-254b-4bf8-8ab1-27038eb3e64d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action" status: 202 len: 0 microversion: 2.1 time: 0.080127 Sep 26 01:40:40.622949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 312/619] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:40:40 2022] POST /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:40:40.632544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:40.633139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:40.639473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.639994 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.640592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.641425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.644253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.645125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.743966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:40.745815 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:40.756003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.756588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.757018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.757926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.758378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.758797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.889856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:40.899230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3ea2863-eca0-4a32-bf5c-74ba0afefae1 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1664 microversion: 2.1 time: 0.271608 Sep 26 01:40:40.911119 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 308/620] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:40 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1664 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:40.921755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:40.925313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:40.934254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.934956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.935551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.936475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:40.937101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:40.937708 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:40.986623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5f059b8-5601-4163-ad8e-d075a4c5ac6d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074055 Sep 26 01:40:40.988467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 309/621] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Sep 26 01:40:40 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:40.995255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:41.003858 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fe2ee7e8-4fb6-4355-a9a4-97e3b999ace0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.266498 Sep 26 01:40:41.016754 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 313/622] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:40 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:41.064514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:41.065042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:41.071128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.071615 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.072053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:41.072775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.073231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.073653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:41.101486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:40:41.200024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c5d5dee-e2f6-4f34-bfdb-c2383bad32a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 204 len: 0 microversion: 2.20 time: 0.138524 Sep 26 01:40:41.200908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 310/623] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Sep 26 01:40:41 2022] DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 01:40:41.210748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:41.211353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:41.217498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.217986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.218414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:41.219266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.219715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.220216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:41.356904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:41.366046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:41.367556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:41.368836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-beeb4246-e1bc-4c5e-80c8-8907e178265d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.162976 Sep 26 01:40:41.369472 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 314/624] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:41 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:41.923828 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:41.924847 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:41.931411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.931900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.932325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:41.933048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:41.933497 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:41.933918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:42.027954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:42.028599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:42.038117 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:42.040563 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:42.046950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:42.048612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:42.051131 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:42.051689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:42.156393 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:42.179681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff16b2b0-0a9c-4636-ae40-aa17c92814c6 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1664 microversion: 2.1 time: 0.260219 Sep 26 01:40:42.197341 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 311/625] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:41 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1664 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:42.256101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:42.264780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9f531b79-8af3-4bd7-94ba-b8e986b1ad38 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.240491 Sep 26 01:40:42.272820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 315/626] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:42 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:42.395618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:42.396226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:42.402459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:42.402944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:42.403377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:42.404068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:42.404917 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:42.405423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:42.552756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:42.560979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:42.562430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:42.563582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78386c6e-2d89-4ab9-930d-e2224fec46b6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.172684 Sep 26 01:40:42.564133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 312/627] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:42 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:43.210055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:43.210055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:43.215011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.215576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.216062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.217120 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.217749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.218185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.289961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:43.290570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:43.297511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.298235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.298879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.300279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.300867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.301298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.595048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:43.604376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-dcaeff43-45df-4915-8213-7166a382321c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1664 microversion: 2.1 time: 0.403971 Sep 26 01:40:43.605189 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 316/628] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:43 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1664 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:43.610213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:43.611089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:43.612325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:43.618389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.619128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.619803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.620680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2c8ca03-9b6e-4953-a824-588a852bacca tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.334922 Sep 26 01:40:43.620834 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:43.621341 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:43.622004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:43.636731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 313/629] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:43 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:43.828964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:43.837258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:43.838701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:43.839864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0f761b2a-ce0c-42ce-94f3-adfe514fd5da tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1724 microversion: 2.20 time: 0.233467 Sep 26 01:40:43.840457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 317/630] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:43 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:44.187561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8390f758-83d5-4553-910b-5ec8bcb93ce6", "name": "network-vif-deleted", "tag": "deb1a57e-3f75-42e2-9d5a-90f0a5f59e30"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:44.204389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.205276 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.206717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.233844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] Creating event network-vif-deleted:deb1a57e-3f75-42e2-9d5a-90f0a5f59e30 for instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 on hv-cinder-85920 Sep 26 01:40:44.241306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0ed2e176-78f1-4e9c-8bde-06e1297f7847 req-1d2f6ea2-e816-433e-b63f-151e5da1d697 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056955 Sep 26 01:40:44.245189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 314/631] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:40:44.634211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:44.635511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:44.645058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.645709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:44.646421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:44.647862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.650729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.651731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.652668 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.654188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.663288 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.663896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.664376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.665135 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.665601 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.666027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.897862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:44.899140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:44.912922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a67e555e-75e2-4c0c-85e3-0cd2670e2352 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1668 microversion: 2.1 time: 0.286074 Sep 26 01:40:44.913563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab0c835f-3e92-4cfb-bf72-d71b5a928b4e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.272598 Sep 26 01:40:44.914373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 318/632] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:44 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1668 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:44.918979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 315/633] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:44 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:44.921558 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:44.923138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:44.929933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.930667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.931297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.932229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.932729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.933157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.970057 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:44.970898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:44.972208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:44.972692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'fault' on Instance uuid 8390f758-83d5-4553-910b-5ec8bcb93ce6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:45.023408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:45.031996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:45.034124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:45.040331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-db534b78-d6e0-4a75-a618-0cf4e97ec4aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1372 microversion: 2.20 time: 0.120230 Sep 26 01:40:45.054436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 319/634] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:44 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:45.940606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:45.941221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:45.947936 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:45.948459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:45.948903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:45.949592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:45.950042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:45.950467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:46.066075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:46.066606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:46.073498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:46.073870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:46.074386 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:46.074998 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:46.075477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:46.076095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:46.085322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:46.093287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29ca6827-f407-4da2-a00e-af15d82afaf6 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.157380 Sep 26 01:40:46.093850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 316/635] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:45 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:46.107948 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:46.108468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:46.108907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:46.109354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'fault' on Instance uuid 8390f758-83d5-4553-910b-5ec8bcb93ce6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:46.150098 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:46.158041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:46.160036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:46.161206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8a108d7d-35f1-4c18-8760-bcd3cabae4b0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1372 microversion: 2.20 time: 0.099292 Sep 26 01:40:46.161793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 320/636] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:46 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:40:47.118005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:47.118526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:47.125162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:47.125642 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:47.126070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:47.126754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:47.127196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:47.127642 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:47.185837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:47.186561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:47.194326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:47.195553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:47.195553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:47.195956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:47.196435 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:47.196855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:47.231077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:47.231498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:47.231928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:47.232395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'fault' on Instance uuid 8390f758-83d5-4553-910b-5ec8bcb93ce6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:40:47.283926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:47.288113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:47.292926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:47.294361 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:47.295508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-81928070-4a84-48fe-9974-116f324a685f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 200 len: 1372 microversion: 2.20 time: 0.113667 Sep 26 01:40:47.296058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 321/637] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:47 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:40:47.296541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07afab19-b2df-48b9-be72-f6e7acf69e5d tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.183331 Sep 26 01:40:47.297172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 317/638] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:47 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:48.319864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:48.320619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:48.323572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:48.324246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:48.327133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:48.327633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:48.328072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:48.328822 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:48.329278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:48.329711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:48.331149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:48.331653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:48.332747 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:48.333756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:48.334216 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:48.334646 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:48.347882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 HTTP/1.1 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:40:48.349590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:40:48.351298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '8390f758-83d5-4553-910b-5ec8bcb93ce6'} Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:40:48.352292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:40:48.353697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:40:48.355148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:40:48.355148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1257ca3c-43ed-4c4e-84e5-403840059152 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 404 len: 111 microversion: 2.20 time: 0.033380 Sep 26 01:40:48.355148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 318/639] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:48 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 01:40:48.359510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10039258-fa9c-498f-adb2-d37b642238e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '.version_select at 0x7f29d3937700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:48.381152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10039258-fa9c-498f-adb2-d37b642238e5 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572725688" status: 204 len: 0 microversion: 2.20 time: 0.025112 Sep 26 01:40:48.381727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 319/640] 10.222.0.25 () {60 vars in 1262 bytes} [Mon Sep 26 01:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572725688 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 01:40:48.472167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:48.481082 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5750d3d1-3a1e-4993-9647-7403a5a00b29 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.165807 Sep 26 01:40:48.481661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 322/641] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:48 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:49.300268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8ad183d-8d7d-4252-8a29-6e238bf5d420 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: .version_select at 0x7f29d389ff70>, body: {"keypair": {"name": "tempest-keypair-469762862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnVJyE+38y36d2vKdDGzTScqtLHje7xSA28WA+bLtwTlXuB1G30KuelibVL84mH0l/K0971HCHQABdDhU6GJE5D/peDLhcMUjaHXIf0pR7QPzBCwHvdQ9th+M6cZxgP8A=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:49.317859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-d8ad183d-8d7d-4252-8a29-6e238bf5d420 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:40:49.321892 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-d8ad183d-8d7d-4252-8a29-6e238bf5d420 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for user bc62747b8aab40d9bff9d853b9b73199 and project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:40:49.346513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8ad183d-8d7d-4252-8a29-6e238bf5d420 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051154 Sep 26 01:40:49.347179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 320/642] 10.222.0.25 () {62 vars in 1200 bytes} [Mon Sep 26 01:40:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 01:40:49.506983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:49.507641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:49.515170 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:49.515853 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:49.516403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:49.517253 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:49.517852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:49.518401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:49.709222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:49.717761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-dee5c32b-4995-42ef-9c31-2c56a8201a54 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.215763 Sep 26 01:40:49.718424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 323/643] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:49 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:50.745632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:50.746936 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:50.752989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:50.754225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:50.755214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:50.756186 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:50.757168 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:50.757789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:50.895141 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-152352636", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5af791d8-1618-4513-8e4d-eb7941c2c427"}], "security_groups": [{"name": "tempest-securitygroup--1350892896"}], "key_name": "tempest-keypair-469762862", "user_data": "}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:50.927053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:50.929410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:50.937779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95e22f6f-2090-4f58-a49f-e1c78b78bde5 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.198060 Sep 26 01:40:50.938349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 321/644] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:50 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:40:51.025601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] validate_networks() for [('5af791d8-1618-4513-8e4d-eb7941c2c427', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:40:51.490850 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:40:51.491301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:40:51.491968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:40:51.492500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:40:51.492919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:40:51.503619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:51.504303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:51.505082 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:51.506025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:51.506623 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:51.507121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:51.524885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:40:51.528825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Getting quotas for user bc62747b8aab40d9bff9d853b9b73199 and project 2f78ca6e22f04c4ab911b2e308338517. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:40:51.540206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:40:51.542597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:40:51.591570 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-85bab8d6-d095-4e64-ac1b-5bcc20d4f094 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.706434 Sep 26 01:40:51.592416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 324/645] 10.222.0.25 () {62 vars in 1188 bytes} [Mon Sep 26 01:40:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 26 01:40:51.605285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:51.606208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:51.693349 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:51.702362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:51.704476 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:51.705927 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-385daae7-84a8-4634-a76b-bceba27914f2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1280 microversion: 2.20 time: 0.105546 Sep 26 01:40:51.707504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 322/646] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:51 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:51.966155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:51.967174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:51.976223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:51.976994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:51.977887 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:51.979039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:51.979770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:51.980274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:52.174016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:52.185852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-788d4b0c-d52b-4999-9377-32677359c524 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.226134 Sep 26 01:40:52.186429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 325/647] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:51 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:52.733114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:52.733717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:52.741455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:52.741991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:52.742607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:52.743579 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:52.744049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:52.744500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:52.831212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:52.840192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:52.841758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:52.842856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c645d477-700f-4997-bb40-802753c878d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1332 microversion: 2.20 time: 0.113606 Sep 26 01:40:52.843401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 323/648] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:52 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:53.212991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:53.213629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:53.221261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:53.221941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:53.223327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:53.224310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:53.229706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:53.230402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:53.502293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:53.511589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-98f290c7-e190-4fb4-8dfb-c59cfc0d19fb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.303195 Sep 26 01:40:53.512929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 326/649] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:53 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:53.876848 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:53.878223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:53.886030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:53.886985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:53.887651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:53.888669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:53.889362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:53.890006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:54.233567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:54.243127 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:54.245363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:54.246733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18b5ad69-914f-4a44-9d1e-e750bd15371e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.374102 Sep 26 01:40:54.251799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 324/650] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:53 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:54.541805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:54.544132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:54.555146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:54.556484 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:54.557897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:54.559526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:54.560450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:54.561675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:54.816318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:54.830904 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6c3277d2-92fe-4fbb-a9ae-11c1b7fd2598 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.295823 Sep 26 01:40:54.832696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 327/651] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:54 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:55.185846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:55.197697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:55.233696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:55.234553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:55.236068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:55.265720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] Creating event network-changed:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:40:55.273560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-eeca72a8-a537-488c-9781-d4ab1614136a req-ebf4fe67-dfa0-43c1-953c-0246828b738c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100113 Sep 26 01:40:55.274470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 325/652] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:40:55.281180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:55.281815 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:55.288725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:55.293091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:55.293786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:55.294677 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:55.295276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:55.295891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:55.302032 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:55.575938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:55.591404 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:55.594419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:55.595787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5c47fbfb-3b74-4c17-8999-7bc42c42769c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.318501 Sep 26 01:40:55.597616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 328/653] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:55 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:55.858397 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:55.859205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:55.867362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:55.869907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:55.870403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:55.871336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:55.871982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:55.872423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:56.051625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:56.074038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54a384d7-42c9-4f9e-8fab-d8ebb3026717 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.220517 Sep 26 01:40:56.075016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 326/654] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:55 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:56.630287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:56.630905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:56.640158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:56.640676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:56.641110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:56.641993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:56.642326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:56.642742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:56.803480 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:56.811855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:56.813335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:56.817436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a27dd8ea-6448-42ed-b845-339c46311896 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.195549 Sep 26 01:40:56.821401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 329/655] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:56 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:57.099837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:57.100855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:57.119504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:57.120000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:57.120989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:57.121714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:57.122167 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:57.122591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:57.419061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:57.435273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91221427-5c32-4563-b50f-e23c939c7215 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.339875 Sep 26 01:40:57.450143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 327/656] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:57 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:57.848862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:57.849578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:57.856446 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:57.857036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:57.857532 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:57.858450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:57.859104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:57.859717 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:58.141760 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:58.160445 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:58.161891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:58.163025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0bd2e847-ef61-4846-a722-1264f850d0aa tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.318697 Sep 26 01:40:58.167770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 330/657] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:57 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:58.462882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:58.464192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:58.471181 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:58.471666 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:58.473035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:58.473983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:58.475133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:58.475728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:58.741010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:58.757226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e5e12c9-2a88-4bd2-8829-19f1979faaf2 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.294790 Sep 26 01:40:58.758632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 328/658] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:58 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:40:59.203718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:59.204317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:59.216176 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:59.216784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:59.217220 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:59.217921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:59.218374 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:59.218788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:59.487005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:59.499297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:59.501165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:40:59.502468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1bbf4707-a21c-4de0-9611-a9e86435d123 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.306502 Sep 26 01:40:59.503749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 331/659] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:40:59 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:40:59.703070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "name": "network-vif-plugged", "status": "completed", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:40:59.724130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:59.727825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:59.728483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:59.749421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] Creating event network-vif-plugged:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:40:59.754994 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-58463873-58f9-4dd1-889a-e8a4e13e56cf req-e5851be1-998f-4946-8a81-9b6a92868e28 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061747 Sep 26 01:40:59.756278 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 329/660] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:40:59.786211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:40:59.787284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:40:59.796609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:40:59.799340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:59.799851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:59.802916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:40:59.803710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:40:59.804801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:40:59.814310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:00.277112 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:00.286993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bf3fe300-4b13-4e22-9076-b2f86618e9ae tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.507591 Sep 26 01:41:00.287576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 332/661] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:40:59 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:00.535302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:00.536557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:00.547783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:00.548491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:00.549185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:00.550376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:00.551026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:00.551668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:00.792095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:00.804322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:00.807424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:00.808925 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3624ba6e-c604-44a9-ae6e-606f09786282 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.279916 Sep 26 01:41:00.810525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 330/662] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:00 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:01.311323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:01.312620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:01.325777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:01.327834 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:01.328266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:01.329611 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:01.330067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:01.330489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:01.514921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:01.536665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:01.611903 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:01.630572 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-53bc3563-4542-468b-a20f-8309d262f588 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1735 microversion: 2.1 time: 0.322537 Sep 26 01:41:01.633122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 333/663] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:01 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:01.845621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:01.847117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:01.855281 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:01.860657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:01.861842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:01.862506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:01.863794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:01.864462 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:01.865967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:02.087696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:02.097561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:02.099738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:02.101117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee52c335-c565-4f0c-83fa-1fb9b1c0aa47 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1406 microversion: 2.20 time: 0.266014 Sep 26 01:41:02.102187 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 331/664] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:01 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:02.665436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:02.666573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:02.684384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:02.684781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:02.687440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:02.690144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:02.693968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:02.694454 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:02.724648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fa314c15-ea7f-4a10-8b6c-fbb8ed9ee3e1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Action: 'create', calling method: .version_select at 0x7f29d3753e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1126381645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASahgta4tKs88AggA31CwNAcNQkZYetPmaMbB2GdtRQft1T/EUuvjT0Xf4WvO4L3Ew0NCtktGy43FI1+kVxsj4OrbruzswIZRQMmr6K3XpMh71QuJluQlucXY3CHT6zRA=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:02.742065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-fa314c15-ea7f-4a10-8b6c-fbb8ed9ee3e1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for project 786ed33f027946f581147e672b947df0. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:41:02.746178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-fa314c15-ea7f-4a10-8b6c-fbb8ed9ee3e1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for user a47ec612bce54bc8b2062b03d36d10d4 and project 786ed33f027946f581147e672b947df0. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:41:02.770602 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fa314c15-ea7f-4a10-8b6c-fbb8ed9ee3e1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.236633 Sep 26 01:41:02.771208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 334/665] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:41:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:03.004783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:03.013799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28c0d0ed-8db0-43d8-8bbf-e5b440bf000f tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1715 microversion: 2.1 time: 0.361407 Sep 26 01:41:03.014476 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 332/666] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:02 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1715 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:41:03.132034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:03.134051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:03.141856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.142624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.144124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.145679 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.146590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.147236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.155521 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:03.156161 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:03.185703 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.188757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.189910 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.191904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.197897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.198384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.343843 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] HTTP exception thrown: Cannot 'detach_volume' instance 5b15f03f-c129-4db7-a021-c160558dbecb while it is in vm_state rescued Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Request method failure captured: Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments/a61f5f0d-04c8-4680-ba47-06afe4723899 HTTP/1.1 Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIV3ytJr8s59BPv6dWRgb8A2pmf2ES3DLTj-vxtS0YBzn7406tdAFU9AmK3JOsdFQLoGiDS-abYnAjNjXB2LS3AVwnHb8nYxDdHjR5CdEXs1dMJkzu9F2pkF3kzpFmphRE_3l_Tj86gs5QgYO4R1NSuAEdaupwbz52fiWIFkl5o7zQ Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:41:03.345556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a553921e97994322b71fda7d032ed8bf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: fb54ba1355004e14b8dc43cf3c028e67 Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:41:03.347494 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Cannot 'detach_volume' instance 5b15f03f-c129-4db7-a021-c160558dbecb while it is in vm_state rescued Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'server_id': '5b15f03f-c129-4db7-a021-c160558dbecb', 'id': 'a61f5f0d-04c8-4680-ba47-06afe4723899'} Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5b15f03f-c129-4db7-a021-c160558dbecb in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:41:03.348389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5b15f03f-c129-4db7-a021-c160558dbecb while it is in vm_state rescued Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5b15f03f-c129-4db7-a021-c160558dbecb while it is in vm_state rescued Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:03.350027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Returning 409 to user: Cannot 'detach_volume' instance 5b15f03f-c129-4db7-a021-c160558dbecb while it is in vm_state rescued {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:41:03.351449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8280bbf6-43c7-4688-bdab-eea871840b1c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments/a61f5f0d-04c8-4680-ba47-06afe4723899" status: 409 len: 152 microversion: 2.1 time: 0.195800 Sep 26 01:41:03.352368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 333/667] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:41:03 2022] DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments/a61f5f0d-04c8-4680-ba47-06afe4723899 => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 01:41:03.357464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:03.358139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:03.371021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.371628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.372130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.373966 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.374661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.375802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.407947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:03.420993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:03.422423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:03.423624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-df433dab-dbaa-4da7-a195-4f2e3a440584 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1598 microversion: 2.20 time: 0.296547 Sep 26 01:41:03.425644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 335/668] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:03 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1598 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:03.458486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:03.459407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:03.471114 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.472473 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.472987 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.473790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.474336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.474669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.503493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-005cc6ba-4e85-4134-a252-25a22c7ade77 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/action" status: 202 len: 0 microversion: 2.1 time: 0.149756 Sep 26 01:41:03.504860 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 334/669] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:41:03 2022] POST /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:41:03.526771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:03.528214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:03.536424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.537238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.537923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.538647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:03.539154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:03.539753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:03.650437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1194de66-cb64-4e7c-b101-583c4c124284 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.201619 Sep 26 01:41:03.651312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 336/670] 10.222.0.25 () {60 vars in 1316 bytes} [Mon Sep 26 01:41:03 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:41:03.903647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:03.917003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38f54412-7c69-4aca-9432-a3cab17daf64 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1723 microversion: 2.1 time: 0.398325 Sep 26 01:41:03.918371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 335/671] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:03 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:04.943661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:04.944411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:04.951014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:04.951673 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:04.952282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:04.953223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:04.953821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:04.954416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:05.164520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:05.173884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-481523b3-d6a8-47ff-8f64-71514083201b tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1723 microversion: 2.1 time: 0.234721 Sep 26 01:41:05.175391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 337/672] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:04 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:05.204239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:05.219234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:05.219727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:05.220205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:05.237165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] Creating event network-changed:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:41:05.246378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bd47e0ae-4623-44f1-9010-279237e341cc req-6319a52f-c4ea-4524-af3a-02d44925ee09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046048 Sep 26 01:41:05.247266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 336/673] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:06.199771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:06.201221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:06.209337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:06.210320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:06.211071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:06.211920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:06.212528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:06.213031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:06.391502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:06.402012 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4134569c-2264-4812-8faa-5839d149ca68 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1729 microversion: 2.1 time: 0.206936 Sep 26 01:41:06.402599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 338/674] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:06 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:06.432086 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:06.432697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:06.478609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:06.482785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:06.485626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:06.489879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:06.490571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:06.492083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:06.705267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ad464b8-39f8-4ffc-a303-8d2ff2508441 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277781 Sep 26 01:41:06.707291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 337/675] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:41:06 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:08.310675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:08.325118 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:08.325594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:08.326023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:08.338898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] Creating event network-changed:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:41:08.344421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-36f22c64-68af-4cf4-aac1-8836327580ea req-97b75f4d-3a8d-44e1-b887-962dc80996ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040408 Sep 26 01:41:08.345320 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 339/676] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:10.360187 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:10.370448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:10.370918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:10.371344 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:10.382478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] Creating event network-changed:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:41:10.387394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d3381a02-a9f9-4e56-be24-cd30eaf5f59d req-0daa3d06-b725-4f6e-8c7f-7621e37f5635 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Sep 26 01:41:10.387963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 338/677] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:21.508842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1506931182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1126381645", "security_groups": [{"name": "tempest-secgroup-smoke-1718875407"}], "block_device_mapping_v2": [{"uuid": "6aed11c5-7a98-4988-b296-f8a98473259d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9880eab6-c89c-4490-9622-c91f1df8e6a8"}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:21.520232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=4 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:21.520976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:21.521645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=59 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:21.629040 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] validate_networks() for [('9880eab6-c89c-4490-9622-c91f1df8e6a8', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:41:22.002478 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:41:22.002890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:41:22.003970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:41:22.004428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:41:22.004883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:41:22.013432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:22.013908 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:22.014332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:22.015077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:22.015523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:22.015939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:22.032597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:41:22.036678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for user a47ec612bce54bc8b2062b03d36d10d4 and project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:41:22.095955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:41:22.098362 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aed11c5-7a98-4988-b296-f8a98473259d',volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:41:22.231282 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8068afa8-49b2-4226-83dd-ab9f893708ce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726608 Sep 26 01:41:22.232119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 340/678] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:41:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 01:41:22.241676 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=27 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:22.242622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:22.247330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93533cd0-6794-4c30-b8a2-519fc49e0dd4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:22.248243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93533cd0-6794-4c30-b8a2-519fc49e0dd4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:22.308097 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-93533cd0-6794-4c30-b8a2-519fc49e0dd4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:22.315366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93533cd0-6794-4c30-b8a2-519fc49e0dd4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1095 microversion: 2.1 time: 0.075518 Sep 26 01:41:22.316625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 339/679] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:22 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:23.339065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:23.339568 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:23.346612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:23.347700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:23.348310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:23.349013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:23.349460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:23.349880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:23.416965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:23.424516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a593918e-3be8-4421-a686-45d6a4e8681b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1193 microversion: 2.1 time: 0.089833 Sep 26 01:41:23.425570 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 341/680] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:23 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:24.448035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:24.448951 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:24.456883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.457469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.457902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.458590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.459037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.460792 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.598938 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:24.601351 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:24.608612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.609098 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.609534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.610227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.610677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.611098 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.641573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eddf4565-44c4-4962-823e-3af3475f192a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.236845 Sep 26 01:41:24.642160 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 340/681] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:41:24 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84/os-volume_attachments => generated 25 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:41:24.679458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:24.689764 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-41b8cdf2-b514-4fd9-b4a9-0e8d7bd854f1 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.245448 Sep 26 01:41:24.690516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 342/682] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:24 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:41:24.712070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:24.712756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:24.718883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.719440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.719938 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.720719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.721168 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.721584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.746978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:41:24.827975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-87ed25bf-7bec-4d43-bcdc-5aa2b4dd7a62 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 204 len: 0 microversion: 2.1 time: 0.119595 Sep 26 01:41:24.831871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 341/683] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:41:24 2022] DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:41:24.837227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:24.837841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:24.845792 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.846331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.846773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:24.847664 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:24.848258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:24.848702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:25.280567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:25.290038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ac171e7b-72be-481f-b719-460d4c9cd97a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1674 microversion: 2.1 time: 0.456935 Sep 26 01:41:25.290729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 343/684] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:24 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1674 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:41:25.308952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86741c60-35b0-4105-9c2d-3f667824cd4d", "tag": "729940fc-9c6b-495b-994b-02d51a549f20"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:25.319402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:25.319877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:25.320296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:25.331673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] Creating event network-changed:729940fc-9c6b-495b-994b-02d51a549f20 for instance 86741c60-35b0-4105-9c2d-3f667824cd4d on hv-cinder-85920 Sep 26 01:41:25.337163 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-50e1f481-03f5-4486-89a1-56b93ecb3944 req-192d1bf1-443d-4b6c-b1aa-5f675e26f31b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032643 Sep 26 01:41:25.337746 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 342/685] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:25.713884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:25.714528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:25.720954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:25.721442 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:25.721879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:25.722571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:25.723033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:25.723460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:25.856238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:25.864215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9f9548e6-e820-45c6-b1be-f1ce999652d9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.154192 Sep 26 01:41:25.864811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 344/686] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:25 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:26.314387 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:26.315007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:26.322022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:26.322511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:26.322952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:26.323654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:26.324122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:26.324575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:26.457029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:26.464555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db00e724-125d-4a38-ad1a-4bda3f22a71d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1674 microversion: 2.1 time: 0.154901 Sep 26 01:41:26.465122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 343/687] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:26 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:26.887130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:26.887864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:26.894716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:26.895217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:26.895659 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:26.896378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:26.896834 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:26.897256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:27.174460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:27.183165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0702f02d-9ca2-4434-9bf0-2e71c4fa95c3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.299964 Sep 26 01:41:27.183983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 345/688] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:26 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:27.489787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:27.490489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:27.496969 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:27.497462 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:27.497895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:27.498593 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:27.499624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:27.500058 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:27.809211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:27.818480 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03d03858-101d-4390-b969-793afe040481 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1674 microversion: 2.1 time: 0.333041 Sep 26 01:41:27.819051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 344/689] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:27 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1674 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:28.207250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:28.208005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:28.215673 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.216244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.216956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.217736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.218306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.218838 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.242249 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84bc271-dfaf-4aac-9c18-29b9202eec84", "name": "network-vif-deleted", "tag": "ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:28.266048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.269854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.272738 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.302023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] Creating event network-vif-deleted:ba1486d9-1aa9-43fb-91ac-392c0b7a9a3c for instance b84bc271-dfaf-4aac-9c18-29b9202eec84 on hv-cinder-85920 Sep 26 01:41:28.308620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bcf69b11-397c-4c4b-8cb4-73678660a08a req-919e61d7-bb9f-4722-b23c-1b5d13dab548 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071570 Sep 26 01:41:28.310711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 345/690] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:28.397168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:28.407685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d0894986-6fc6-4511-ae28-c81a76f98531 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.204672 Sep 26 01:41:28.425381 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 346/691] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:28 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:28.843378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:28.844086 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:28.851371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.851861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.852291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.853000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.853714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.853886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.886046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:28.886553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:28.886988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:28.887427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lazy-loading 'fault' on Instance uuid b84bc271-dfaf-4aac-9c18-29b9202eec84 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:41:28.931951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:28.941130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1c23b0e-06d6-4dad-84d8-d1f23e8d13c5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 200 len: 1327 microversion: 2.1 time: 0.101720 Sep 26 01:41:28.943071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 346/692] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:28 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:29.431676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:29.432283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:29.438721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:29.439215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:29.439652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:29.441088 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:29.441548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:29.441970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:29.571540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:29.579385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-33b2778b-75a3-41db-8d31-dc67a7221cc7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.151588 Sep 26 01:41:29.579953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 347/693] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:29 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:29.966023 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:29.966632 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:29.973723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:29.974211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:29.974647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:29.975334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:29.975790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:29.976215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:29.989434 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 HTTP/1.1 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:41:29.991112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:41:29.992744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'b84bc271-dfaf-4aac-9c18-29b9202eec84'} Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:41:29.993662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:41:29.995155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:29.996508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:41:29.996508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a1a5327-5069-447e-a217-74ac3009734e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 404 len: 111 microversion: 2.1 time: 0.030376 Sep 26 01:41:29.996508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 347/694] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:29 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:41:30.001314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7b7e55c6-cb10-45d0-ab72-f8ac65ede6bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '.version_select at 0x7f29d3782550>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:30.021601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7b7e55c6-cb10-45d0-ab72-f8ac65ede6bf tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464159838" status: 202 len: 0 microversion: 2.1 time: 0.023983 Sep 26 01:41:30.022163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 348/695] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Sep 26 01:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464159838 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:41:30.603820 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:30.604216 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:30.611446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:30.611446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:30.611446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:30.612113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:30.612886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:30.613597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:30.644689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1c4e2cad-c3b6-4828-ae61-83cceb5c06d9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: .version_select at 0x7f29d37b0040>, body: {"keypair": {"name": "tempest-keypair-1106403687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRDaRllVNqHU6uoR4r02O1hVIFz2U/gT6M4eUo27gcTMMyycUUyxi+Mx8KxdmPHMF17De5Vs0WP+MgBLhBjbROBcWu68s71WAG4G2K3DsHq0ZafQqzogoN+hC0Rl3QHnw=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:30.663931 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-1c4e2cad-c3b6-4828-ae61-83cceb5c06d9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for project 3677555d86804f03ae243765cfd3fd24. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:41:30.667981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-1c4e2cad-c3b6-4828-ae61-83cceb5c06d9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for user 06043e862a394764a58003f205cbb484 and project 3677555d86804f03ae243765cfd3fd24. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:41:30.692077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1c4e2cad-c3b6-4828-ae61-83cceb5c06d9 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051983 Sep 26 01:41:30.692933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 349/696] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:41:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:30.766533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:30.777922 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-26433230-f003-4892-96b2-840ab01232eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.178116 Sep 26 01:41:30.778607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 348/697] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:30 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:31.807857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:31.808580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:31.814752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:31.815337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:31.815843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:31.816589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:31.817048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:31.817734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:31.953379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:31.961955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c2d4f50f-812a-4673-b543-53fef107575b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.158617 Sep 26 01:41:31.962547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 350/698] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:31 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:41:32.007712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1721652951", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "698acfe8-54a1-4ab3-9d7d-022ce3847edf"}], "security_groups": [{"name": "tempest-securitygroup--1579028352"}], "key_name": "tempest-keypair-1106403687", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:32.116235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] validate_networks() for [('698acfe8-54a1-4ab3-9d7d-022ce3847edf', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:41:32.312605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:32.578668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:41:32.579085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:41:32.579557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:41:32.579961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:41:32.580383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:41:32.589508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:32.589989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:32.590422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:32.591147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:32.591620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:32.592043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:32.608907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for project 3677555d86804f03ae243765cfd3fd24. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:41:32.614238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Getting quotas for user 06043e862a394764a58003f205cbb484 and project 3677555d86804f03ae243765cfd3fd24. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:41:32.629175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:41:32.631420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:41:32.682152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a052702-4f05-4ed1-9f73-40bf406094dd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678630 Sep 26 01:41:32.682802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 349/699] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:41:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:41:32.694129 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9880a74f-3f90-4f69-a8c0-9baec5770c10 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:32.694745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9880a74f-3f90-4f69-a8c0-9baec5770c10 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:32.696677 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:32.750839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9880a74f-3f90-4f69-a8c0-9baec5770c10 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:32.758607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9880a74f-3f90-4f69-a8c0-9baec5770c10 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1238 microversion: 2.1 time: 0.068566 Sep 26 01:41:32.759172 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 351/700] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:32 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:32.985377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:32.985983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:32.993949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:32.994560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:32.995016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:32.995701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:32.996145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:32.996594 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:33.137377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:33.146071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f72982b-dfca-4464-bcd4-4496c2843956 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.164071 Sep 26 01:41:33.146511 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 350/701] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:32 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:33.782875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:33.783483 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:33.791269 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:33.791856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:33.792392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:33.793094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:33.793548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:33.793974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:33.854954 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:33.862707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-98de5b7d-80e1-4484-af0d-ad91b20a8a30 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1242 microversion: 2.1 time: 0.083684 Sep 26 01:41:33.863279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 352/702] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:33 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:34.168802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:34.169405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:34.176270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:34.176799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:34.177271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:34.178117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:34.178576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:34.179030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:34.312133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:34.320989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c5b8157-bdf9-4707-b593-137912fe277a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.155973 Sep 26 01:41:34.321546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 351/703] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:34 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:34.885475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:34.886080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:34.892490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:34.892974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:34.894162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:34.894856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:34.895306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:34.895722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:34.964199 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:34.972644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-25aee821-dc0f-4045-9404-e138cf17abad tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1296 microversion: 2.1 time: 0.090859 Sep 26 01:41:34.973229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 353/704] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:34 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:35.343993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:35.344841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:35.351767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:35.352319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:35.352842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:35.353605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:35.354126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:35.354657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:35.551336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:35.561014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f02beec-9362-47e6-b65b-0d2094df972d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.221431 Sep 26 01:41:35.561523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:35 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:35.997127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:35.997725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:36.004800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:36.005278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:36.005707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:36.006416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:36.006841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:36.007255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:36.255512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:36.264220 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9d0d5ac1-f650-42c3-85fc-91dfb050cfb4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.270971 Sep 26 01:41:36.264838 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 354/706] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:35 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:36.496398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69a7773-22c8-4916-bf97-3f99fe7f84d7", "tag": "73a4ae19-05f7-45db-a9b9-7d5ecba082d1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:36.509210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:36.509962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:36.510384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:36.522143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] Creating event network-changed:73a4ae19-05f7-45db-a9b9-7d5ecba082d1 for instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 on hv-cinder-85920 Sep 26 01:41:36.527285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0922d230-259e-49ac-8e68-a17f63e405fd req-0adc3985-9e24-43fe-b515-dcd872bb021b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057748 Sep 26 01:41:36.528037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 353/707] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:36.584809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:36.585421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:36.591358 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:36.591840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:36.592309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:36.593023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:36.593475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:36.593895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:36.802938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:36.811578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ad46cc1b-10be-4768-992f-3aee16369ec5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.231059 Sep 26 01:41:36.812169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 355/708] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:36 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:37.288250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:37.288986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:37.295069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:37.295549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:37.295979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:37.296693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:37.297140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:37.297559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:37.427138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:37.434671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69fc797f-a66d-403f-b3fe-df7d39e95b47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.151377 Sep 26 01:41:37.435241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 354/709] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:37 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:37.788144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86741c60-35b0-4105-9c2d-3f667824cd4d", "name": "network-vif-plugged", "status": "completed", "tag": "729940fc-9c6b-495b-994b-02d51a549f20"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:37.798759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:37.799409 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:37.799839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:37.811380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] Creating event network-vif-plugged:729940fc-9c6b-495b-994b-02d51a549f20 for instance 86741c60-35b0-4105-9c2d-3f667824cd4d on hv-cinder-85920 Sep 26 01:41:37.817443 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-683e8e35-9ca7-42f0-93c0-a82fce7c8ba6 req-a0206dff-05f4-41b4-929c-f3b5e00992aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Sep 26 01:41:37.818045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 356/710] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:37.835611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:37.836222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:37.842584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:37.843076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:37.843518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:37.844213 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:37.844705 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:37.845234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:38.023498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:38.031143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-775a744a-0ec3-433a-b1de-d82fbb334e90 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.199468 Sep 26 01:41:38.031706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 355/711] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:37 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:38.458025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:38.458665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:38.464856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:38.465342 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:38.465776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:38.466461 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:38.466913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:38.467338 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:38.670247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:38.678855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ac6b7d13-155d-4930-968e-27e73acbbb58 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.225045 Sep 26 01:41:38.679437 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 357/712] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:38 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:39.054306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:39.054912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:39.061379 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:39.061859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:39.062287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:39.062972 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:39.063418 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:39.063835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:39.201971 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:39.210035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d136a0c8-fa5e-4047-8c01-9cf5e304e1ae tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1267 microversion: 2.1 time: 0.159591 Sep 26 01:41:39.210596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 356/713] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:39 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:39.702274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:39.702881 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:39.709331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:39.709816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:39.710612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:39.710938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:39.711391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:39.711812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:39.843178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:39.851494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-301e4647-94ce-49e4-9b5f-48fd56788096 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.153033 Sep 26 01:41:39.852078 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 358/714] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:39 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:40.232249 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:40.232915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:40.240024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.240544 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.240974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:40.241672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.242125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.242543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:40.376789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:40.380389 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:40.385171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3eeefc42-05b5-45d6-a673-8d3ec559bc61 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1455 microversion: 2.1 time: 0.156843 Sep 26 01:41:40.385733 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 357/715] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:40 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:40.407470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:40.408071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:40.414634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.415105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.415528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:40.416205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.416673 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.417089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:40.544913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:40.553436 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f461e54a-3ada-4a32-ae88-d0b0f9e35a3d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1455 microversion: 2.1 time: 0.149840 Sep 26 01:41:40.554002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 359/716] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:40 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:40.875235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:40.875845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:40.883017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.883514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.883953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:40.884681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:40.885132 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:40.885556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:41.094524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:41.102953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-479e9e26-912c-4b60-9596-46ff5af97c9b tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.231676 Sep 26 01:41:41.103517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 358/717] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:40 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:41.817426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69a7773-22c8-4916-bf97-3f99fe7f84d7", "name": "network-vif-plugged", "status": "completed", "tag": "73a4ae19-05f7-45db-a9b9-7d5ecba082d1"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:41.828884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:41.829470 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:41.829964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:41.842205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] Creating event network-vif-plugged:73a4ae19-05f7-45db-a9b9-7d5ecba082d1 for instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 on hv-cinder-85920 Sep 26 01:41:41.847308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-0ff4a8f5-b502-4b9b-850c-43ba9cddb978 req-9149db38-91ef-4d1f-89ae-ee58c3a8c6f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Sep 26 01:41:41.848219 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 360/718] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:42.126253 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:42.126856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:42.134425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:42.134918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:42.135356 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:42.136063 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:42.136547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:42.136973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:42.557562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:42.565918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2461606-be05-4657-a3d0-1a7cbe7e7d0d tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.443518 Sep 26 01:41:42.566489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 359/719] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:42 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:42.756151 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=12 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:42.792739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86741c60-35b0-4105-9c2d-3f667824cd4d", "tag": "729940fc-9c6b-495b-994b-02d51a549f20"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:42.804042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:42.804548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:42.805181 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:42.817488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] Creating event network-changed:729940fc-9c6b-495b-994b-02d51a549f20 for instance 86741c60-35b0-4105-9c2d-3f667824cd4d on hv-cinder-85920 Sep 26 01:41:42.822527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-160cd195-f296-43a4-a5fc-7ba8eec73849 req-a4a7b48f-d632-4f19-b8e5-4dc7ea3e7ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094588 Sep 26 01:41:42.823456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 361/720] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:43.589184 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:43.589796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:43.604218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:43.605538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:43.608455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:43.609155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:43.609968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:43.611026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:43.611740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:43.612362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:43.748657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:43.759455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fef0f3f-4d6b-4c99-8855-c840de390d18 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1364 microversion: 2.1 time: 0.174067 Sep 26 01:41:43.760043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 360/721] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:43 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:44.322631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:44.323210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:44.329238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.329718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.330776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:44.331463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.331907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.332321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:44.335943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=100 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:44.357647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b3fa4873-5f6f-4962-8d9c-2e43c8bcc72e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/ips" status: 200 len: 152 microversion: 2.20 time: 0.143623 Sep 26 01:41:44.358203 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 362/722] 10.222.0.25 () {60 vars in 1289 bytes} [Mon Sep 26 01:41:44 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 01:41:44.782978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:44.783600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:44.790109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.790594 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.791031 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:44.791784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.792176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.792623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:44.922122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:44.930474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55ca01b6-ac81-4f42-839e-d27a51df8967 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1550 microversion: 2.1 time: 0.151340 Sep 26 01:41:44.931038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 361/723] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:44 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:44.954529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:44.955275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:44.961363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.961853 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.962289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:44.962980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:44.963732 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:44.964163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:45.041898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0543f1f8-f32b-4fbe-888c-eb8f4f1422d2 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091219 Sep 26 01:41:45.042499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 363/724] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:41:44 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:45.972673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c69a7773-22c8-4916-bf97-3f99fe7f84d7", "tag": "73a4ae19-05f7-45db-a9b9-7d5ecba082d1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:45.982633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:45.983114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:45.983543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:45.994873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] Creating event network-changed:73a4ae19-05f7-45db-a9b9-7d5ecba082d1 for instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 on hv-cinder-85920 Sep 26 01:41:45.999835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c3953bc7-b950-4096-a721-af6078837972 req-b30016f7-754e-4bce-9c14-e97b3d9ad965 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031688 Sep 26 01:41:46.000446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 362/725] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:46.864555 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:46.865091 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:46.871292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:46.871783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:46.872216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:46.872949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:46.873402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:46.873830 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:46.899288 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lazy-loading 'flavor' on Instance uuid b76df5cd-18f2-4253-a3ff-3ccdf78507a6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:41:47.093346 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a17e5ccb-2535-4f29-9f51-9293a7a0de2d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/action" status: 202 len: 0 microversion: 2.20 time: 0.233187 Sep 26 01:41:47.093946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 364/726] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Sep 26 01:41:46 2022] POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:41:47.103866 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:47.108896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:47.117125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:47.117612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:47.118046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:47.119017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:47.119470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:47.119912 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:47.254970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:47.262849 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:47.264279 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:47.265453 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f5a8711-eb70-4ad2-bc4e-6d4be4fdf26d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.166496 Sep 26 01:41:47.265998 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 363/727] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:47 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:48.292218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:48.292851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:48.299089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:48.299565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:48.299994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:48.300707 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:48.301159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:48.301575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:48.431021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:48.438972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:48.440968 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:48.442373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2198aa3a-b240-4cdc-a0a8-3caba103a227 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.155030 Sep 26 01:41:48.442919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 365/728] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:48 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:49.449328 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:49.449877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:49.456868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.457351 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.457785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.458473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.458924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.459348 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.467898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:49.468548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:49.475622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.476105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.476585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.477283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.477733 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.478158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.543338 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'services' on Instance uuid 5b15f03f-c129-4db7-a021-c160558dbecb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:41:49.613357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:49.617868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0437472-bdf7-48f8-9024-66306bf09d97 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments/a61f5f0d-04c8-4680-ba47-06afe4723899" status: 202 len: 0 microversion: 2.1 time: 0.172270 Sep 26 01:41:49.618552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 364/729] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:41:49 2022] DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments/a61f5f0d-04c8-4680-ba47-06afe4723899 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:41:49.622818 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:49.626010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:49.627161 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:49.627293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ef8342d9-e063-4c5e-8370-e767d0274c6c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.163086 Sep 26 01:41:49.629517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:49.635605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.636283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.636745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.637436 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:49.637954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:49.638383 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:49.644054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 366/730] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:49 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:41:49.670078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a8ea2d3-8967-430e-a7c0-3ed5a1ca9a66 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Sep 26 01:41:49.670654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 365/731] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:41:49 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:41:50.656227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:50.656864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:50.663146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.663625 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.664050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.664766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.665207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.665624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.683238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:50.685485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:50.692947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.693429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.693859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.694542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.694997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.695415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.735350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6c36c9e-300d-463f-adb0-59f93a2fef12 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056051 Sep 26 01:41:50.735976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 366/732] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:41:50 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 01:41:50.804615 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:50.808752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:50.810189 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:50.811347 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2a449ab9-a913-4fc2-b2a3-ec37be8838c7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.158988 Sep 26 01:41:50.811895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 367/733] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:50 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:50.813148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:50.813645 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:50.820316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.820828 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.821263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.821949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.822398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.822819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.847868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:41:50.920092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-127e3490-526a-430e-b312-e82d355974bf tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 204 len: 0 microversion: 2.1 time: 0.111431 Sep 26 01:41:50.920988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 367/734] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:41:50 2022] DELETE /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:41:50.929782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:50.930489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:50.936711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.937144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.937585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:50.938284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:50.938742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:50.939809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:51.071435 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:51.079207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6aed642e-eb34-4d43-b31a-04bbde371499 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1689 microversion: 2.1 time: 0.153537 Sep 26 01:41:51.079949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 368/735] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:50 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:51.839097 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:51.839783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:51.846882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:51.847357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:51.847789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:51.848509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:51.848959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:51.849378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:51.981274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:51.990070 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:51.991510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:51.992742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40330ec1-197e-46cd-9626-5fb97dfd346b tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.158106 Sep 26 01:41:51.993301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 368/736] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:51 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:52.102529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:52.103065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:52.105589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:52.112098 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:52.112613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:52.113047 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:52.113728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:52.114175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:52.114593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:52.245833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:52.253832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-400b58e3-b870-493b-ace9-242b924005d9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1689 microversion: 2.1 time: 0.155261 Sep 26 01:41:52.254401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 369/737] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:52 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:53.019049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:53.019610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:53.022010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:53.027379 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:53.027863 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:53.028299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:53.029014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:53.029469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:53.029896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:53.160753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:53.168657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:53.170082 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:53.171222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbd67d11-9235-4af4-9ae0-348a016aaed6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.156753 Sep 26 01:41:53.171782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 369/738] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:53 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:53.276878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:53.277442 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:53.283888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:53.284408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:53.284851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:53.285536 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:53.285985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:53.286408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:53.417018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:53.425164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2f949a29-914e-46d9-9e52-2007a5de93e4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1689 microversion: 2.1 time: 0.152145 Sep 26 01:41:53.425726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 370/739] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:53 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:54.198230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:54.198828 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:54.206096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:54.206572 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:54.207001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:54.207681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:54.208155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:54.208598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:54.338303 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:54.346390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:54.347807 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:54.348991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9dc6457e-d8c1-4387-99d7-1c3480b05fc3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.154638 Sep 26 01:41:54.349561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 370/740] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:54 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:54.448843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:54.449455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:54.456598 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:54.457088 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:54.457526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:54.458221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:54.458675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:54.459098 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:54.599051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:54.606608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e6045369-9bb3-4d40-a989-9ff2c601a434 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1689 microversion: 2.1 time: 0.161753 Sep 26 01:41:54.607173 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 371/741] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:54 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:41:55.374055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:55.374657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:55.381636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:55.382123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:55.382552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:55.383248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:55.383691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:55.384125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:55.631049 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:55.631706 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:55.638141 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:55.638630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:55.639065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:55.639761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:55.640207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:55.640693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:55.755414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:55.763913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-30504540-7ae4-4ad9-8da8-d256fcef6522 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 200 len: 1621 microversion: 2.1 time: 0.137211 Sep 26 01:41:55.764633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 372/742] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:55 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 1621 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:41:55.823932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:55.832554 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:55.834014 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:55.835161 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-469f8940-c78f-46d7-9199-521a9f3d82d9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.465096 Sep 26 01:41:55.835702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 371/743] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:55 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:55.974637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b15f03f-c129-4db7-a021-c160558dbecb", "name": "network-vif-deleted", "tag": "6a6db24c-6002-495f-ba8b-4e1c78db3a08"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:55.985058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:55.985578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:55.986879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:55.998327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] Creating event network-vif-deleted:6a6db24c-6002-495f-ba8b-4e1c78db3a08 for instance 5b15f03f-c129-4db7-a021-c160558dbecb on hv-cinder-85920 Sep 26 01:41:56.003974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-4facefd8-d563-409b-a06b-10094116b6b7 req-e8579af3-712c-4aca-89db-136ac5a672fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 Sep 26 01:41:56.004656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 373/744] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:41:56.789895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:56.790519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 5b15f03f-c129-4db7-a021-c160558dbecb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:56.797289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:56.797779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:56.798813 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:56.799571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:56.800000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:56.800453 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:56.814747 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] HTTP exception thrown: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Request method failure captured: Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb HTTP/1.1 Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIV3ytJr8s59BPv6dWRgb8A2pmf2ES3DLTj-vxtS0YBzn7406tdAFU9AmK3JOsdFQLoGiDS-abYnAjNjXB2LS3AVwnHb8nYxDdHjR5CdEXs1dMJkzu9F2pkF3kzpFmphRE_3l_Tj86gs5QgYO4R1NSuAEdaupwbz52fiWIFkl5o7zQ Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:41:56.816403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a553921e97994322b71fda7d032ed8bf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: fb54ba1355004e14b8dc43cf3c028e67 Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. Sep 26 01:41:56.818306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '5b15f03f-c129-4db7-a021-c160558dbecb'} Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:41:56.819235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. Sep 26 01:41:56.820773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:41:56.822202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Returning 404 to user: Instance 5b15f03f-c129-4db7-a021-c160558dbecb could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:41:56.822202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32440020-076a-41d4-84d0-bd4fe115e6e9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb" status: 404 len: 111 microversion: 2.1 time: 0.032500 Sep 26 01:41:56.822202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 372/745] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:56 2022] GET /compute/v2.1/servers/5b15f03f-c129-4db7-a021-c160558dbecb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:41:56.828261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-86c79004-9566-4abb-b598-215dc96089eb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '.version_select at 0x7f29d3782d30>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:56.849015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-86c79004-9566-4abb-b598-215dc96089eb tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376116333" status: 202 len: 0 microversion: 2.1 time: 0.025591 Sep 26 01:41:56.849603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 374/746] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Sep 26 01:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376116333 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 01:41:56.860261 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:56.860957 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:56.867227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:56.867718 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:56.868158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:56.868883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:56.869336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:56.869761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:56.888992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:41:57.062225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:57.072682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:57.074228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:57.075577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57549852-32c2-4220-b425-4a62d2729d19 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.219211 Sep 26 01:41:57.084729 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 373/747] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:56 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:58.103033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:58.103860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:58.110441 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:58.111552 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:58.111991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:58.112719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:58.113174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:58.113601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:58.246867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:58.254965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:58.256328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:58.257513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-372b27ed-0e89-40b0-8b74-79eda70a057f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1744 microversion: 2.20 time: 0.159011 Sep 26 01:41:58.258076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 375/748] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:58 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:59.283080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:59.283688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:59.290074 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:59.290562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:59.290997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:59.291681 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:59.292131 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:59.292589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:59.421222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:59.430046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:59.431486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:41:59.432719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9fc273a8-09db-456c-ae56-51c50c353147 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1744 microversion: 2.20 time: 0.153567 Sep 26 01:41:59.433290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 374/749] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:41:59 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:41:59.821222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:59.821746 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:59.828581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:59.830000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:59.830487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:59.831272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:59.831731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:59.832234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:59.859326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:41:59.980106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d292f356-e4f1-4638-92fb-daafffe670c4 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 204 len: 0 microversion: 2.1 time: 0.162045 Sep 26 01:41:59.981116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 376/750] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:41:59 2022] DELETE /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:41:59.990915 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:41:59.991626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:41:59.993471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "name": "network-vif-plugged", "status": "completed", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:41:59.997774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:41:59.998271 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:41:59.998715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:41:59.999431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:00.002390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:00.003638 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:00.006601 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:00.007326 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:00.009310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:00.023996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] Creating event network-vif-plugged:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:42:00.029835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3dd02667-6a33-4317-9b36-bafea605165e req-bf6525da-8c1d-485d-8fed-3bee164bed44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114459 Sep 26 01:42:00.034189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 375/751] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:00.036155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:00.174062 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:00.181942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3649fd89-337d-4e4a-a42a-1918280037ed tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1507 microversion: 2.1 time: 0.195296 Sep 26 01:42:00.182981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 377/752] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:41:59 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:00.461111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:00.462888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:00.469588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:00.470333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:00.470876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:00.471623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:00.472088 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:00.472550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:00.614106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:00.626698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:00.628178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:00.629678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0e1cb6b9-e263-4cc5-9656-890c186a7dc9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.173165 Sep 26 01:42:00.630456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 376/753] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:00 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:01.206359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:01.206987 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:01.214334 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:01.214828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:01.215269 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:01.215971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:01.216460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:01.216887 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:01.383903 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:01.393393 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1e075851-1f3d-4370-bcee-5ff21994c5f0 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1507 microversion: 2.1 time: 0.189437 Sep 26 01:42:01.402262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 378/754] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:01 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:01.657857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:01.658985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:01.666021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:01.666811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:01.667445 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:01.668213 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:01.668895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:01.669483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:01.819411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:01.830753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:01.832208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:01.833612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11817b7d-92ca-4592-8833-f9a3d4dc354c tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.180473 Sep 26 01:42:01.834255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 377/755] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:01 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:02.417736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:02.418290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:02.425504 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:02.426204 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:02.426810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:02.427717 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:02.428177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:02.428629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:02.686646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:02.719432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-978d851d-219c-4479-982b-824f6ba64bce tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1507 microversion: 2.1 time: 0.306707 Sep 26 01:42:02.721296 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 379/756] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:02 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:02.861845 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:02.862392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:02.870035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:02.870869 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:02.871484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:02.872744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:02.873470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:02.874090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:03.130082 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:03.146267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:03.147895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:03.149358 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53014738-bd27-45f6-be67-21c0f818e69d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.292401 Sep 26 01:42:03.150392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 378/757] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:02 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:03.315957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a794b36a-7e0c-48a0-9a10-b397017feafb", "name": "network-vif-deleted", "tag": "02b15285-09ae-477c-be6b-9cf27ce25a1f"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:03.326485 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:03.327469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:03.328158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:03.340960 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] Creating event network-vif-deleted:02b15285-09ae-477c-be6b-9cf27ce25a1f for instance a794b36a-7e0c-48a0-9a10-b397017feafb on hv-cinder-85920 Sep 26 01:42:03.347563 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-9ec72202-7e9b-4169-8641-ff586378cdef req-96fa2355-6bac-4a36-be25-daa2a8103c06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035212 Sep 26 01:42:03.353469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 380/758] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:03.759551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:03.760498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:03.770040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:03.770691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:03.771227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:03.772042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:03.772647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:03.773162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:03.818419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:03.818907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:03.819333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:03.819829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'fault' on Instance uuid a794b36a-7e0c-48a0-9a10-b397017feafb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:03.875491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:03.884175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bfd2f01e-3bee-49e6-a48d-33483c083d65 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 200 len: 1312 microversion: 2.1 time: 0.128863 Sep 26 01:42:03.884788 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 379/759] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:03 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:04.178830 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:04.179622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:04.186608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.187318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.187741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.189386 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.189880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.190335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.349286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:04.361351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:04.362788 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:04.363969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f0847fb5-bba6-408e-96ea-9917d61215a3 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.192111 Sep 26 01:42:04.369616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 381/760] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:04 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:04.907618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:04.909084 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: a794b36a-7e0c-48a0-9a10-b397017feafb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:04.916266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.916797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.917235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.917934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.918384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.918808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.934443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] HTTP exception thrown: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Request method failure captured: Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb HTTP/1.1 Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIV3ytJr8s59BPv6dWRgb8A2pmf2ES3DLTj-vxtS0YBzn7406tdAFU9AmK3JOsdFQLoGiDS-abYnAjNjXB2LS3AVwnHb8nYxDdHjR5CdEXs1dMJkzu9F2pkF3kzpFmphRE_3l_Tj86gs5QgYO4R1NSuAEdaupwbz52fiWIFkl5o7zQ Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:42:04.936468 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a553921e97994322b71fda7d032ed8bf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: fb54ba1355004e14b8dc43cf3c028e67 Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. Sep 26 01:42:04.937897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'a794b36a-7e0c-48a0-9a10-b397017feafb'} Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:42:04.939320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. Sep 26 01:42:04.940992 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:04.943440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Returning 404 to user: Instance a794b36a-7e0c-48a0-9a10-b397017feafb could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:42:04.943440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95bc0d6f-797d-443b-91eb-07b7b834dcc9 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb" status: 404 len: 111 microversion: 2.1 time: 0.034765 Sep 26 01:42:04.943440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 380/761] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:04 2022] GET /compute/v2.1/servers/a794b36a-7e0c-48a0-9a10-b397017feafb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:42:04.949323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:04.950023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:04.957389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.959697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.959697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.959697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:04.959697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:04.960063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:04.987927 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:42:05.088731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0249749a-67ee-4c70-9eb3-69a017082611 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 204 len: 0 microversion: 2.1 time: 0.143383 Sep 26 01:42:05.089913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 382/762] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:42:04 2022] DELETE /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:42:05.099083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:05.099789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:05.106272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:05.107039 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:05.107696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:05.108634 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:05.109289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:05.109731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:05.260908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:05.270433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-42d3a53c-a809-4769-b21d-1dfc90fe38de tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.176504 Sep 26 01:42:05.273798 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 381/763] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:05 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:05.392507 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:05.393965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:05.400913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:05.401495 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:05.402013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:05.402801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:05.403326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:05.403895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:05.557285 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:05.565877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:05.567578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:05.568765 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-90275446-8182-46a9-948c-79993704f0b2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.180954 Sep 26 01:42:05.569513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 383/764] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:05 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:06.296722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:06.298414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:06.306617 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:06.307041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:06.307485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:06.308192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:06.308675 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:06.311143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:06.457283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:06.465429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b537c447-cb0d-4837-a513-a134f05abd3c tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.172633 Sep 26 01:42:06.466324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 382/765] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:06 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:06.596308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:06.596875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:06.603389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:06.604116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:06.604749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:06.605635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:06.606095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:06.606521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:06.760588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:06.773863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:06.775364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:06.776655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-40ad3dc9-05b5-4bf6-9e9c-cd26aff56351 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.186065 Sep 26 01:42:06.777448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 384/766] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:06 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:07.489788 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:07.490399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:07.497134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:07.497862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:07.498302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:07.499002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:07.499456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:07.499888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:07.746495 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:07.757575 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8367997-89cc-4f8d-bba1-9cf165ef0400 tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1520 microversion: 2.1 time: 0.271424 Sep 26 01:42:07.774166 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 383/767] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:07 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:07.805012 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:07.805617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:07.819816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:07.820455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:07.822916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:07.822916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:07.822916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:07.822916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:08.029557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:08.055723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:08.076388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:08.076388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-329e810d-7117-48c7-b1ea-0c90d3131d0f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.260113 Sep 26 01:42:08.076388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 385/768] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:07 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:08.239232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6a0f6a-2168-483e-91c0-cbc3174cc2e0", "name": "network-vif-deleted", "tag": "2225fa4c-2032-458b-bdb1-24d6a09e40c1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:08.249851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:08.251475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:08.252232 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:08.273727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] Creating event network-vif-deleted:2225fa4c-2032-458b-bdb1-24d6a09e40c1 for instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 on hv-cinder-85920 Sep 26 01:42:08.281045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f96f8683-3ede-4f74-8cf6-d8afe8756db3 req-e22ccfc7-5493-4bdc-be02-f6a9be0e06ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046344 Sep 26 01:42:08.285513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 384/769] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:42:08.787115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:08.787689 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:08.795476 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:08.796045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:08.796638 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:08.798071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:08.798536 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:08.798965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:08.833742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:08.834383 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:08.834662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:08.835116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lazy-loading 'fault' on Instance uuid 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:08.891873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb54ba1355004e14b8dc43cf3c028e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553921e97994322b71fda7d032ed8bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:08.903018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e62b1319-d3bc-46c1-9740-a3d9f0e1303a tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 200 len: 1311 microversion: 2.1 time: 0.122642 Sep 26 01:42:08.915557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 386/770] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:08 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:09.091766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:09.092480 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:09.100153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.100927 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.101366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.102060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.102509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.102929 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.249817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:09.258804 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:09.260285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:09.261487 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aecaac9d-e2a6-4208-81d6-7126741340b7 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1739 microversion: 2.20 time: 0.174683 Sep 26 01:42:09.262053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 385/771] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:09 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:09.442776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:09.443298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:09.450023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.450506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.450930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.451615 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.452063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.452512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.475394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lazy-loading 'flavor' on Instance uuid 891098ae-6262-467f-814b-d930d1540931 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:09.548841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9ba825cd-e367-412b-829c-5a8b9ac79257 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "POST /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931/action" status: 202 len: 0 microversion: 2.1 time: 0.108956 Sep 26 01:42:09.549635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 387/772] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:42:09 2022] POST /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:42:09.557585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:09.558133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:09.564046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.564574 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.565007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.565691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.566143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.566825 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.696108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:09.704489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44a154e0-b06a-4d56-ba81-8530dd6a9910 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.150010 Sep 26 01:42:09.705178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 386/773] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:09 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:09.927499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:09.928195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] [instance: 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:09.934771 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.935251 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.935685 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.936399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.936857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.937331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.947516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "name": "network-vif-unplugged", "status": "completed", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:09.956279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] HTTP exception thrown: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. Sep 26 01:42:09.958140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Request method failure captured: Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 HTTP/1.1 Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIV3ytJr8s59BPv6dWRgb8A2pmf2ES3DLTj-vxtS0YBzn7406tdAFU9AmK3JOsdFQLoGiDS-abYnAjNjXB2LS3AVwnHb8nYxDdHjR5CdEXs1dMJkzu9F2pkF3kzpFmphRE_3l_Tj86gs5QgYO4R1NSuAEdaupwbz52fiWIFkl5o7zQ Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:42:09.958607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a553921e97994322b71fda7d032ed8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a553921e97994322b71fda7d032ed8bf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: a553921e97994322b71fda7d032ed8bf Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-669169417 Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: fb54ba1355004e14b8dc43cf3c028e67 Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-ServerRescueNegativeTestJSON-669169417-project Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. Sep 26 01:42:09.960212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '8e6a0f6a-2168-483e-91c0-cbc3174cc2e0'} Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:42:09.961986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. Sep 26 01:42:09.963595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:42:09.966931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:09.966931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:09.968601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] Returning 404 to user: Instance 8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:42:09.969671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f6cb06c4-dd8e-4386-96df-70ade697a40e tempest-ServerRescueNegativeTestJSON-669169417 tempest-ServerRescueNegativeTestJSON-669169417-project] 10.222.0.25 "GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0" status: 404 len: 111 microversion: 2.1 time: 0.046232 Sep 26 01:42:09.970456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 388/774] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:09 2022] GET /compute/v2.1/servers/8e6a0f6a-2168-483e-91c0-cbc3174cc2e0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:42:09.981018 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] Creating event network-vif-unplugged:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:42:09.985871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2dc574dd-693d-41f7-9d03-98f0f1775ff6 req-03c816b5-6788-4ace-8fcf-1ac7addbc652 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041929 Sep 26 01:42:09.986461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 387/775] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:42:10.287133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:10.287743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:10.293720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:10.294210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:10.294647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:10.295350 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:10.295892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:10.296561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:10.525089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:10.534167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:10.535984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:10.537238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8bdf623b-fee6-4033-802a-065c0c6e7991 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1721 microversion: 2.20 time: 0.254010 Sep 26 01:42:10.548633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 389/776] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:10 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:10.729280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:10.730089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:10.736722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:10.737214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:10.737644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:10.738329 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:10.738776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:10.739193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:10.883536 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:10.892245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ec0d92c-ed9b-447e-92eb-0ecc1ff638b3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.167685 Sep 26 01:42:10.892852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 388/777] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:10 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:11.564056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:11.564670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:11.570816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:11.571305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:11.571739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:11.572452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:11.572905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:11.573797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:11.711946 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:11.721127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:11.722629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:11.723817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2e868b8c-e29e-4510-89ea-8713bd91d17d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1721 microversion: 2.20 time: 0.164104 Sep 26 01:42:11.724392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 390/778] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:11 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:11.914884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:11.915483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:11.922091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:11.922923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:11.923600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:11.924540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:11.925211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:11.925693 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:12.075150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:12.083353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f2cc01d-4832-4f45-a0d3-063a6d614457 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.172260 Sep 26 01:42:12.084043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 389/779] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:11 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:12.749800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:12.751520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:12.758170 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:12.758839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:12.759360 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:12.760125 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:12.760609 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:12.761031 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:12.780168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:12.972576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:12.985702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:12.988679 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:12.993503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-afbfe9ca-9dd2-4590-8308-a6aac640b13d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1724 microversion: 2.20 time: 0.247856 Sep 26 01:42:12.994405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 391/780] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:12 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:13.023404 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a38d6ff5-400d-4f8d-aade-1eb9035b3744"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:13.025767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:13.056106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.056541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.056982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.057699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.058150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.058563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.131051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:13.137966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:13.152144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.152693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.153142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.155730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.156133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.158540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.446852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:13.613125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-410267db-2cfe-4b6f-9098-780a98a86e51 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.593662 Sep 26 01:42:13.614228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 390/781] 10.222.0.25 () {62 vars in 1364 bytes} [Mon Sep 26 01:42:13 2022] POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments => generated 188 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 01:42:13.789647 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:13.789963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:13.805959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.806897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.807517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.808684 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:13.809218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:13.809809 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:13.845075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:13.852228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e5fd198a-60f8-48ac-a464-777a5ffee8a1 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.746596 Sep 26 01:42:13.852830 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 392/782] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:13 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:14.092588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af3f3646-f3b0-4737-9db1-46de531a6eea tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments/a38d6ff5-400d-4f8d-aade-1eb9035b3744" status: 202 len: 0 microversion: 2.20 time: 0.312098 Sep 26 01:42:14.093475 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 391/783] 10.222.0.25 () {60 vars in 1457 bytes} [Mon Sep 26 01:42:13 2022] DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments/a38d6ff5-400d-4f8d-aade-1eb9035b3744 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:42:14.157477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:14.158182 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:14.165152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.165770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.166610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:14.167536 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.167996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.168498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:14.200471 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127126) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 01:42:14.270956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-56e36481-1a4f-404e-a353-f2bd1056f3bd tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/action" status: 202 len: 0 microversion: 2.20 time: 0.119065 Sep 26 01:42:14.271585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 393/784] 10.222.0.25 () {62 vars in 1319 bytes} [Mon Sep 26 01:42:14 2022] POST /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:42:14.281687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:14.282893 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:14.290271 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.291234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.292029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:14.292989 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.293514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.294166 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:14.439605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:14.448580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:14.450024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:14.451424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-231ef2ba-6092-4008-ad56-27bb1ecbf213 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1672 microversion: 2.20 time: 0.174482 Sep 26 01:42:14.453188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 392/785] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:14 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:14.877688 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:14.878392 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:14.884416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.885053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.885601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:14.886305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:14.886763 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:14.887212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:15.048089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:15.058871 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-30902c00-072c-44ab-99e7-4b58ec510da0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.186272 Sep 26 01:42:15.059875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 394/786] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:14 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:15.481843 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:15.482669 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:15.489618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:15.490353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:15.490792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:15.491493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:15.491941 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:15.492378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:15.642450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:15.651516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:15.653189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:15.654433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70f6536f-26ea-4cb7-aebf-fa97d13e8368 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1674 microversion: 2.20 time: 0.178104 Sep 26 01:42:15.655270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 393/787] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:15 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:16.084681 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:16.085294 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:16.092713 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:16.093202 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:16.093639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:16.094536 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:16.094993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:16.095413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:16.492421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:16.510694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d898ee13-e132-43a1-8c93-675e693880de tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.425337 Sep 26 01:42:16.528275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 395/788] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:16 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:16.681027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:16.681675 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:16.688413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:16.689047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:16.689490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:16.690190 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:16.690643 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:16.691515 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:16.982421 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:16.991247 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:16.992729 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:16.993877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a88c066b-a139-4123-9f9f-b546183bdfd1 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.316964 Sep 26 01:42:16.994439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 394/789] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:16 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:17.540426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:17.541339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:17.552161 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:17.553127 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:17.553301 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:17.554099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:17.555735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:17.556284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:17.833298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:17.841240 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-945de687-d98a-475b-b784-51875ce3c60f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.304663 Sep 26 01:42:17.842925 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 396/790] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:17 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:18.020255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:18.021573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:18.032609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:18.033420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:18.034272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:18.035089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:18.041773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:18.042580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:18.297888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:18.309047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:18.310926 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:18.313173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45f01a66-1118-4072-8ab6-ba376b2edf91 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.297174 Sep 26 01:42:18.313964 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 395/791] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:18 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:18.865918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:18.867302 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:18.875935 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:18.883487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:18.884201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:18.885339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:18.886050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:18.886710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:19.112025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:19.122607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e8fe8d11-7180-4223-854f-485c1bb56af2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.260550 Sep 26 01:42:19.123195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 397/792] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:18 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:19.339888 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:19.348779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:19.366793 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:19.368377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:19.372535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:19.373422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:19.373998 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:19.374537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:19.635629 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:19.646674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:19.654590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:19.656308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be826b5b-8f5c-4dc6-a144-56393418ecc4 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.321056 Sep 26 01:42:19.668663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 396/793] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:19 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:20.148145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:20.149385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:20.157421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:20.158184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:20.158857 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:20.159667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:20.160355 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:20.161046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:20.521407 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:20.532600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ad5a132a-1eaf-41c7-894b-ba6d5b30bd7a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.388171 Sep 26 01:42:20.533855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 398/794] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:20 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:20.688504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:20.689767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:20.698285 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:20.699044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:20.699646 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:20.700827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:20.701474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:20.728806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:20.995113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:21.004991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:21.006931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:21.011415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-603723e6-4f3f-45e0-a253-cd227ff77e0d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.329095 Sep 26 01:42:21.012073 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 397/795] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:20 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:21.263982 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7d20f3da-6034-4547-8c5b-e0033773436b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: .version_select at 0x7f29d3737790>, body: {"keypair": {"name": "tempest-keypair-443178607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGORw8gwUKyv6ov3IXUKVMJEiiunMAl+KgreHhnFXVZVKdb/wARUOVHw7l/6XzoPXp1LlsXsDJnC9xsVXAcPdxr2HsoLRkOwoAKbYaZf/4uxj3cMg9229fl5bojcAMNUtg=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:21.283325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-7d20f3da-6034-4547-8c5b-e0033773436b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:42:21.288995 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-7d20f3da-6034-4547-8c5b-e0033773436b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:42:21.324967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7d20f3da-6034-4547-8c5b-e0033773436b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.261739 Sep 26 01:42:21.325936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 399/796] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:42:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:21.561973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:21.563289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:21.589103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:21.590009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:21.590765 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:21.591796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:21.592438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:21.593048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:21.834972 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:21.847075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbd7adda-9c71-493c-8da7-13e923e3cdd5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.288627 Sep 26 01:42:21.848425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 398/797] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:21 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:22.041767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:22.042743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:22.072655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:22.073564 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:22.074632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:22.075548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:22.076039 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:22.076547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:22.274769 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:22.285569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:22.287102 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:22.288626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-632f4dab-3d4c-426e-a9c6-b63321ed5e6a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.251764 Sep 26 01:42:22.289708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 400/798] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:22 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:22.872705 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:22.873342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:22.882761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:22.883546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:22.884206 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:22.885478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:22.886152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:22.887114 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:23.108805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:23.119739 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-543a178b-8daf-41c7-85de-fe7d1c627522 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.251004 Sep 26 01:42:23.121136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 399/799] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:22 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:23.320908 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:23.322335 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:23.335430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571751525", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f9f02f3-760e-48dc-b09d-e8f3d058e4c5"}], "security_groups": [{"name": "tempest-securitygroup--1546305784"}], "key_name": "tempest-keypair-443178607", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:23.337828 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:23.339265 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:23.344806 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:23.345456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:23.346315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:23.346892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:23.347423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:23.360205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=64 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:23.567748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] validate_networks() for [('3f9f02f3-760e-48dc-b09d-e8f3d058e4c5', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:42:23.720992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:23.734641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:23.736092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:23.737309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0d348985-c1dd-4807-a8c6-eb59332ff84a tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.421864 Sep 26 01:42:23.739400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 401/800] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:23 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:24.148991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:24.149943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:24.157179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.162535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.163264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.165196 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.165930 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.173117 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.485274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:42:24.485919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:42:24.486164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:42:24.486584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:42:24.487707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:42:24.510969 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.511469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.511897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.512661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.513127 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.513553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.551762 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:24.562478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:42:24.563432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-23ec78ff-aec6-4e1c-af37-975893386158 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.418288 Sep 26 01:42:24.564306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 402/801] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:24 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:24.591400 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:42:24.614379 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:42:24.619525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:42:24.705100 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-43ccde3c-b2bd-4f2f-adb3-3b16aa0eea3b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.374074 Sep 26 01:42:24.706591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 400/802] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:42:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:42:24.719345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9c631709-8807-4d46-a40b-7adedf7947fe tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:24.719961 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9c631709-8807-4d46-a40b-7adedf7947fe tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:24.765867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:24.766624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:24.778337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.795900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.797033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.797879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:24.798353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:24.798790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:24.808966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9c631709-8807-4d46-a40b-7adedf7947fe tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:24.818594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9c631709-8807-4d46-a40b-7adedf7947fe tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1240 microversion: 2.1 time: 0.104375 Sep 26 01:42:24.821018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 403/803] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:24 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:25.081209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:25.089999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:25.091413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:25.092582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f85e284-e349-45d0-9091-b052e5ea78eb tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.331272 Sep 26 01:42:25.100558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 401/804] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:24 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:25.588901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:25.589717 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:25.603479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:25.603984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:25.604458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:25.605180 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:25.609686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:25.610231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:25.808941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:25.817903 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-13e5b7b4-dab0-4e89-97a8-8a4bfc382542 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.234678 Sep 26 01:42:25.818485 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 404/805] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:25 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:25.849865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:25.851202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:25.860398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:25.865066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:25.865740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:25.866660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:25.867281 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:25.869323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:25.938263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:25.947340 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-307db26d-219e-41ed-a73a-5ebd39cbf6cc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1244 microversion: 2.1 time: 0.101330 Sep 26 01:42:25.961977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 402/806] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:25 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:26.122594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:26.123481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:26.130143 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.130626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.131053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.131743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.132187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.132629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.278399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:26.292553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:26.294148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:26.295354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0daa6bea-5f32-4e39-8138-d6fbc9281046 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.176698 Sep 26 01:42:26.295918 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 405/807] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:26 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:26.842173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:26.842903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:26.849978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.850641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.850951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.851772 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.852249 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.852711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.973011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:26.973827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:26.980724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.981279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.981839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.982574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:26.983121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:26.983544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:26.989062 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:26.997075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06bc675a-d3d0-4183-92ad-68cd1cb4bb40 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.158914 Sep 26 01:42:26.997639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 403/808] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:26 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:27.046990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:27.054819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-aff82da6-c9c1-4f36-b1a5-515f477ab0c8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1244 microversion: 2.1 time: 0.087584 Sep 26 01:42:27.055341 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 406/809] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:26 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:27.323365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:27.323939 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:27.331263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:27.331754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:27.332191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:27.332909 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:27.333358 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:27.333778 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:27.505290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:27.507500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=91,nova_cell1:UPDATE=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:27.516571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:27.518017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:27.519164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98626b11-04bc-4278-9076-75d8d5554886 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.200469 Sep 26 01:42:27.519724 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 404/810] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:27 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:28.020807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:28.021423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:28.027725 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.028236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.028695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.029380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.029831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.030250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.078600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:28.079411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:28.086353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.086834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.087264 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.087949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.088416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.088838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.169375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:28.177683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-393677bb-eb72-4c2e-a548-13fdb14a78bf tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1236 microversion: 2.1 time: 0.103444 Sep 26 01:42:28.178176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 405/811] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:28 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:28.188652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:28.196675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-61327526-e752-491f-a6b3-5c68fe9acce3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.179677 Sep 26 01:42:28.197237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 407/812] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:28 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:28.544626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:28.545332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:28.552220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.552731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.553163 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.553854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:28.554298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:28.554716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:28.759449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:28.768272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:28.769719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:28.770851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ecb4952-1660-4670-8977-159c0f24161f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.230173 Sep 26 01:42:28.771413 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 406/813] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:28 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:29.200330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:29.201140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:29.208162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.208677 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.209110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.209790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.210234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.210647 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.219571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:29.220176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:29.226571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.227049 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.227482 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.228173 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.228661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.229142 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.282156 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:29.290514 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-17991a46-6ebf-4ee8-8f9e-7888aafa9a15 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1310 microversion: 2.1 time: 0.093921 Sep 26 01:42:29.291089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 408/814] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:29 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:29.381123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:29.388751 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b29db088-8bc0-4167-823a-4fad4204f031 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.173749 Sep 26 01:42:29.389315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 407/815] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:29 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:29.458410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:29.458888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:29.464975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.465454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.465886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.466561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.467008 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.467426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.471318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:29.492005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f4d6df85-0a82-4307-a99d-d7311b698b99 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/ips" status: 200 len: 146 microversion: 2.1 time: 0.037401 Sep 26 01:42:29.492666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 409/816] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:42:29 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:29.797099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:29.797743 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:29.803577 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.804172 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.804667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.805437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:29.805960 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:29.806388 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:29.938812 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:29.947024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:29.948514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:29.949683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34d21c51-922c-4aee-9eb3-f0013136d91f tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.157525 Sep 26 01:42:29.950243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 408/817] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:29 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:30.315610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:30.316535 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:30.323835 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.324384 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.324809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.325504 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.325949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.326368 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.413305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:30.414539 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:30.421029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.422562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.423001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.423886 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.424337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.424777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.428121 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:30.443556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0f839541-7641-4641-8597-b9e460769e83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1298 microversion: 2.1 time: 0.132173 Sep 26 01:42:30.452578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 410/818] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:30 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:30.649301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:30.657191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-99d1ec52-870d-490f-94f3-224553443572 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.248178 Sep 26 01:42:30.657706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 409/819] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:30 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:30.831166 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd909068-7fcc-4d42-a2b9-bc1de57fe055"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:30.833917 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:30.840011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.840531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.840965 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.841692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.842143 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.842563 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.975437 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:30.976134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:30.982260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.982745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.983198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:30.984560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:30.985106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:30.985459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.151708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b0207a07-fe28-4328-9b87-4df286b9f4e0 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324378 Sep 26 01:42:31.152642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 411/820] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:42:30 2022] POST /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:31.264000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:31.275972 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:31.277637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:31.279104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b6c6807-451b-4c15-addd-d7c68d315644 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.307559 Sep 26 01:42:31.282217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 410/821] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:30 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:31.469545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:31.470251 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:31.477781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.478276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.478740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.479648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.480107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.480565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.681382 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:31.682013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:31.689319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.689895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.690428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.691610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.692077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.692598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.728283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:31.736953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e26cbe4e-4601-4af4-81c2-b20c85a22782 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.273730 Sep 26 01:42:31.737533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 412/822] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:31 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:31.885122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:31.893656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-071aa201-ede4-4b1c-84fd-33f5b905a91b tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1569 microversion: 2.1 time: 0.216209 Sep 26 01:42:31.894238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 411/823] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:31 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:31.917463 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:31.917994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:31.924682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.925171 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.925610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.926305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:31.926758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:31.927179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:31.957969 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127126) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 01:42:32.043526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-abef76ce-cae3-486b-8162-c086421709bd tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "POST /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931/action" status: 202 len: 0 microversion: 2.1 time: 0.126686 Sep 26 01:42:32.045879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 413/824] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:42:31 2022] POST /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:42:32.051288 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3064a59e-2e5b-4254-bf1d-c76b549b31c6", "tag": "27ddfb03-d280-4cbc-98a9-c970a48fbd87"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:32.071233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:32.073079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:32.074307 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.074874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.075342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.085597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.086721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.087593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.088569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.089255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.089922 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.091334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] Creating event network-changed:27ddfb03-d280-4cbc-98a9-c970a48fbd87 for instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 on hv-cinder-85920 Sep 26 01:42:32.116789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-480519b0-652a-4ab8-8a57-14a9db2658fb req-06721041-62b0-496b-9b05-d963457887b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074795 Sep 26 01:42:32.118047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 412/825] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:32.319949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:32.321186 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:32.328651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.329141 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.329756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.330513 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.331118 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.331854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.386812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:32.399798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-deddc1c7-a255-423c-8179-349c9a8bf3ea tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1517 microversion: 2.1 time: 0.336575 Sep 26 01:42:32.401500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 414/826] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:32 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:32.417359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "name": "network-vif-plugged", "status": "completed", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:32.429213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.429944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.431009 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.448288 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] Creating event network-vif-plugged:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:42:32.454644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-e4af69a1-265e-4a8f-9d67-3bf88b8dbefe req-4e5dcaaf-53e0-43a9-a9ab-023a6f34fb6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051575 Sep 26 01:42:32.455741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 415/827] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:32.535863 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:32.544707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:32.551560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:32.555646 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39894697-c299-4f1f-81ec-787017c00a84 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.239933 Sep 26 01:42:32.556278 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 413/828] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:32 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:32.763289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:32.763976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:32.770955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.773794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.774289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:32.775483 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:32.776085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:32.776836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:33.009484 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:33.020619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-638bdba1-50cd-4734-a101-5f15238d9278 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.261501 Sep 26 01:42:33.021501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 416/829] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:32 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:33.427320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:33.428113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:33.434861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:33.435425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:33.435854 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:33.436600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:33.437320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:33.437744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:33.583899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:33.584449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:33.591269 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:33.591761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:33.592192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:33.592926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:33.593377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:33.593800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:33.794393 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:33.804247 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:33.804581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:33.805973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:33.807128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d1e50432-153d-4c7a-9684-f22596bb7caf tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.227301 Sep 26 01:42:33.807683 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 417/830] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:33 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:42:33.817109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-26c924b7-1752-4040-96f6-7de267a65467 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1519 microversion: 2.1 time: 0.394089 Sep 26 01:42:33.817810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 414/831] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:33 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:34.047812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:34.048452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:34.054402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.054894 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.055332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.056132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.056625 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.057050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.211375 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:34.220067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-488173d0-7c59-48a7-86d0-bd748e0b390d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.176898 Sep 26 01:42:34.220672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 418/832] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:34 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:34.479635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891098ae-6262-467f-814b-d930d1540931", "name": "network-vif-unplugged", "status": "completed", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:34.490631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.491368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.492025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.505414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_external_events [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] Unable to find a host for instance 891098ae-6262-467f-814b-d930d1540931. Dropping event network-vif-unplugged {{(pid=127125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 01:42:34.506369 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d76da687-64ae-4db9-b2fd-f435437f3fd0 req-188734bd-3f30-4b86-b24d-91edaeb7e66f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030596 Sep 26 01:42:34.506959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 415/833] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 26 01:42:34.835026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:34.835743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:34.838662 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:34.841355 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:34.841969 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:34.844919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.845411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.845546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:34.845844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.846099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:34.846956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.847179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.847603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.849780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.850273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.850691 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:34.851592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:34.852081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:34.853130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:35.101360 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:35.109716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:35.110894 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:35.112475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:35.114752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9561c15f-dd97-45a5-876a-8b8dbf475cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1730 microversion: 2.20 time: 0.283492 Sep 26 01:42:35.117944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-99988278-aeb8-437d-8c45-008de19ca573 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1519 microversion: 2.1 time: 0.280672 Sep 26 01:42:35.119199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 416/834] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:34 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:35.129046 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 419/835] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:34 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1730 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:35.243230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:35.243861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:35.250718 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:35.251210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:35.251648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:35.252407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:35.252896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:35.253323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:35.649583 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:35.657996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86b88c83-ab91-4ebf-baaf-c4775295c262 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.418590 Sep 26 01:42:35.658548 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 417/836] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:35 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:36.141765 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:36.142020 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:36.142456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:36.142544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:36.148163 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.148700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.148952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.149129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.149441 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.149877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.150029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.150465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.150601 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.151003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.151117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.151416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.344755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:36.348394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:36.352452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6b4632f-4a19-4773-ac15-3ed57b93f72a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1519 microversion: 2.1 time: 0.215146 Sep 26 01:42:36.353009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 418/837] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:36 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:36.356690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:36.358169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:36.360216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2585b503-66ce-4ea0-b479-f5b3070790e2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1717 microversion: 2.20 time: 0.223039 Sep 26 01:42:36.360805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 420/838] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:42:36 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1717 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:42:36.523890 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3064a59e-2e5b-4254-bf1d-c76b549b31c6", "name": "network-vif-plugged", "status": "completed", "tag": "27ddfb03-d280-4cbc-98a9-c970a48fbd87"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:36.534324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.535148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.535571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.546941 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] Creating event network-vif-plugged:27ddfb03-d280-4cbc-98a9-c970a48fbd87 for instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 on hv-cinder-85920 Sep 26 01:42:36.551698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d5ce9152-bc1e-46fe-9843-7081fa7165e8 req-efad592a-914c-4e56-96ee-6034690b3cf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031358 Sep 26 01:42:36.552273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 419/839] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:36.681715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:36.682318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:36.688928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.689417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.689851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.690797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:36.691247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:36.691671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:36.859578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:36.867071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7a7eba6f-40a4-4cb2-b4bc-ceacafceccc3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.189526 Sep 26 01:42:36.867636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 421/840] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:36 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:37.377630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:37.378299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:37.385108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:37.385580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:37.386147 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:37.386901 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:37.387361 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:37.387783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:37.518787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:37.526459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c692be95-16f0-4cb2-9925-ac4b7b28b981 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1519 microversion: 2.1 time: 0.153387 Sep 26 01:42:37.527028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 420/841] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:37 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:37.890133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:37.890795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:37.897176 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:37.897656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:37.898088 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:37.898764 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:37.899211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:37.899629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.031104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:38.038947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-703eed0a-f56d-4eec-b6a9-e54e79df6c78 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1366 microversion: 2.1 time: 0.152849 Sep 26 01:42:38.039529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 422/842] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:37 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:38.550719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:38.551350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:38.559779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.561041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.561783 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.563488 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.564015 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.564832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.719533 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:38.727311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-722bd185-34e1-4fa9-b43a-87d917a450cc tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1519 microversion: 2.1 time: 0.180853 Sep 26 01:42:38.727879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 421/843] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:38 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:38.776221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:38.778529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:38.785242 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.785724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.786159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.786849 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.787303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.787723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.817406 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fe880bcb-d08a-4c55-9b9b-9342e140412c tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 26 01:42:38.817964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 423/844] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:42:38 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:38.829716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:38.830208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:38.836252 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.836780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.837218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.837915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:38.838373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:38.838801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:38.869481 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7264bca5-37fc-4eaf-b032-f5de8b21dd87 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055" status: 200 len: 194 microversion: 2.1 time: 0.044092 Sep 26 01:42:38.869979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 422/845] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Sep 26 01:42:38 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:39.062295 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:39.063010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:39.069935 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.070424 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.070840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:39.071546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.071998 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.072450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:39.096449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:39.239943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:39.252359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-771a6b09-bf0b-45b4-8bcb-eaa3510e75cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1555 microversion: 2.1 time: 0.193446 Sep 26 01:42:39.253397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 424/846] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:39 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:39.275639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:39.276136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:39.281953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.282538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.282963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:39.283653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.284108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.284566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:39.298717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:39.367461 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-517bdeb6-9121-4e24-b0ee-2a0635c08b9b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095646 Sep 26 01:42:39.368041 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 423/847] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:42:39 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:39.751281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:39.752178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:39.758920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.759413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.759853 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:39.760594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:39.761051 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:39.761477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:40.110134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:40.118188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-662ee525-485a-472a-8cef-ab253e7785cf tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.370948 Sep 26 01:42:40.118802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 425/848] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:39 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:40.241235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cac5ec09-34ee-4f49-a885-9a6f06f8fd20"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:40.243654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:40.249787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:40.250352 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:40.250877 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:40.251637 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:40.252189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:40.252709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:40.507776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f764ef5-ca2a-4e0f-9dd1-62923cdb061f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "POST /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270541 Sep 26 01:42:40.508399 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 424/849] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:42:40 2022] POST /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:40.811279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3064a59e-2e5b-4254-bf1d-c76b549b31c6", "tag": "27ddfb03-d280-4cbc-98a9-c970a48fbd87"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:40.822030 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:40.822639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:40.823183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:40.835588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] Creating event network-changed:27ddfb03-d280-4cbc-98a9-c970a48fbd87 for instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 on hv-cinder-85920 Sep 26 01:42:40.840947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-08a2a2ae-0a05-49d4-85af-aff515ca44a2 req-557eb019-ba5b-471f-b1d8-f56d749091a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033821 Sep 26 01:42:40.841557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 426/850] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:41.143407 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:41.144096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:41.150947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:41.151441 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:41.151873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:41.152598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:41.153050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:41.153474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:41.368785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:41.377975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fbc037a-ed12-4456-be7a-56c14cc6a590 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.238933 Sep 26 01:42:41.378674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 425/851] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:41 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:42.402797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:42.403405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:42.410403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:42.410882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:42.411325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:42.412007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:42.412483 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:42.412900 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:42.542676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:42.550972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-45eb0aca-d534-4420-8a72-2e3b9e767101 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.152423 Sep 26 01:42:42.551575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 427/852] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:42 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:43.574853 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:43.575458 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:43.582559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:43.583040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:43.583472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:43.584154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:43.584634 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:43.585055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:43.717124 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:43.725125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2986e55c-cc2f-4cab-826c-4991fb7e7d57 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.154077 Sep 26 01:42:43.725683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 426/853] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:43 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:44.748403 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:44.748948 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:44.755846 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:44.756336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:44.756800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:44.757494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:44.757949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:44.758400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:44.893408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:44.901178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-37136cd4-34ff-4c7c-b72b-686b6aa519b2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.156745 Sep 26 01:42:44.901750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 428/854] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:44 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:45.926068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:45.926677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:45.933311 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:45.933785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:45.934225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:45.934920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:45.935377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:45.935806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:46.071682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:46.080127 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a56e16d2-e735-420a-9337-5e0b1342370e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.158008 Sep 26 01:42:46.080671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 427/855] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:45 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:47.103704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:47.104261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:47.111096 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:47.111569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:47.111998 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:47.112708 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:47.113153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:47.113569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:47.242933 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:47.251983 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-eb4c2105-2213-45ea-b2a1-c79503770779 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.152380 Sep 26 01:42:47.252592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 429/856] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:47 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:48.274999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:48.275606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:48.282066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:48.282553 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:48.283000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:48.283679 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:48.284132 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:48.284581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:48.414609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:48.422203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b51bc885-b358-4907-93a6-7b159b70329f tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.151070 Sep 26 01:42:48.422769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 428/857] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:48 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:49.141365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:49.143522 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:49.149811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.150606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.151041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.151718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.152165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.152620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.184136 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3bec5b39-4a9d-4a41-bfcc-b244e2dc558f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047143 Sep 26 01:42:49.184715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 430/858] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:42:49 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:49.326703 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:49.327217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:49.336743 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.337378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.337821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.338522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.338972 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.339467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.369603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-681b6798-2ec9-401a-b22f-35ed8e26f92a tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055" status: 200 len: 194 microversion: 2.1 time: 0.046934 Sep 26 01:42:49.370190 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 429/859] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Sep 26 01:42:49 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:49.380661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:49.381150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:49.387390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.387866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.388292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.388994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.389444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.389859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.445288 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:49.446033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:49.452089 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.452616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.453128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.454401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:49.454855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:49.455372 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:49.475782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lazy-loading 'services' on Instance uuid c69a7773-22c8-4916-bf97-3f99fe7f84d7 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:49.550551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-cdf31993-4cb4-49f8-9627-981edc037a47 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055" status: 202 len: 0 microversion: 2.1 time: 0.173437 Sep 26 01:42:49.551759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 431/860] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:42:49 2022] DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/bd909068-7fcc-4d42-a2b9-bc1de57fe055 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:42:49.599233 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:49.615796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55baed52-daa4-412a-8618-58654b0153e0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.174181 Sep 26 01:42:49.616395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 430/861] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:49 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:42:50.640197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:50.642330 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:50.649072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.649772 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.650356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.651216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.651940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.652266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.681876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:50.682405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:50.691542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.692508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.692885 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.693771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.694274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.694741 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.734308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b79108f2-315f-40d6-84e6-45b60ad673a5 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/cac5ec09-34ee-4f49-a885-9a6f06f8fd20" status: 200 len: 194 microversion: 2.1 time: 0.056957 Sep 26 01:42:50.735216 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 431/862] 10.222.0.25 () {58 vars in 1413 bytes} [Mon Sep 26 01:42:50 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/cac5ec09-34ee-4f49-a885-9a6f06f8fd20 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:50.745954 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:50.746441 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:50.753550 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.754429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.755029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.755914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:50.756568 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:50.757156 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:50.796390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:50.805955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3c671ffb-b1c0-4054-bd5f-455f357329eb tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.170466 Sep 26 01:42:50.806538 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 432/863] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:50 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:50.846946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lazy-loading 'services' on Instance uuid c69a7773-22c8-4916-bf97-3f99fe7f84d7 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:50.918096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20a678de-a79f-4804-b741-aba431368a2f tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/cac5ec09-34ee-4f49-a885-9a6f06f8fd20" status: 202 len: 0 microversion: 2.1 time: 0.175986 Sep 26 01:42:50.918770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 432/864] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:42:50 2022] DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments/cac5ec09-34ee-4f49-a885-9a6f06f8fd20 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 01:42:51.831100 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:51.831660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:51.837955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:51.838439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:51.838873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:51.839589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:51.840043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:51.840491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:51.974819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:51.982449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-42662f4f-ed84-45b9-ba9e-e84e8a4aca42 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.156021 Sep 26 01:42:51.983023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 433/865] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:51 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:52.098251 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:52.100626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:52.107126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.107350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.107787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.108518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.108983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.109517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.139416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d2247647-f067-449a-a53a-97d3e791b681 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046155 Sep 26 01:42:52.139977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 433/866] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:42:52 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:42:52.206019 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891098ae-6262-467f-814b-d930d1540931", "name": "network-vif-plugged", "status": "completed", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:52.217145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.217626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.218052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.229497 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] Creating event network-vif-plugged:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:42:52.234932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-77c78b24-ddba-402e-bb80-8634504adcd3 req-6c712b9c-ffa5-4303-8e77-e779307f67d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Sep 26 01:42:52.235903 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 434/867] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:52.262587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:52.264830 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:52.271861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.272378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.272803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.273495 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.274117 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.274542 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.304479 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3cc5044-c12c-484e-b812-19be675f7bdb tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045751 Sep 26 01:42:52.305034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 434/868] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:42:52 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:42:52.369784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:52.370366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:52.377221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.377714 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.378154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.378852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.379312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.379742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.406775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:42:52.486512 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ca960ed6-d804-4eb0-86de-6e5f1e9689c4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 204 len: 0 microversion: 2.1 time: 0.120569 Sep 26 01:42:52.487134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 435/869] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:42:52 2022] DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:42:52.495506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:52.496120 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:52.502390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.502899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.503335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.504107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:52.504692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:52.505009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:52.635546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:52.643268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6db527a-8fcd-4fdc-a567-11feee8aeeca tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1675 microversion: 2.1 time: 0.151770 Sep 26 01:42:52.643822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 435/870] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:52 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:53.006138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:53.006829 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:53.013158 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:53.013635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:53.014061 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:53.014738 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:53.015179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:53.016104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:53.150694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:53.158921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f5ec9cd2-5d75-4472-858c-6a2f7ceba00d tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.157028 Sep 26 01:42:53.159487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 436/871] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:53 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:53.667079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:53.667608 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:53.670013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:53.675566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:53.676056 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:53.676523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:53.677228 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:53.677682 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:53.678110 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:53.807509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:53.816174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23f939b0-12b8-443d-ba16-bad9c94b77a4 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1675 microversion: 2.1 time: 0.152999 Sep 26 01:42:53.816777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 436/872] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:53 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:54.181894 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:54.182844 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:54.185347 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:54.192499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:54.193118 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:54.193589 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:54.194281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:54.194732 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:54.195152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:54.331080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:54.338743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e784cc02-c329-4cf8-b52a-d78e4e503727 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1575 microversion: 2.1 time: 0.160717 Sep 26 01:42:54.339313 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 437/873] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:54 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:54.839056 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:54.839659 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:54.846801 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:54.847256 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:54.847695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:54.848401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:54.848849 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:54.849266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:55.055522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:55.063674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ce0e268-e891-44af-8a3b-b1e60673848e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1675 microversion: 2.1 time: 0.228404 Sep 26 01:42:55.064234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 437/874] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:54 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:55.361941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:55.362548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:55.371465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:55.371947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:55.372401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:55.373142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:55.373590 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:55.374004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:55.560136 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:55.568498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-280e410a-0d5f-442b-ad7d-4ae19215516e tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1562 microversion: 2.1 time: 0.210574 Sep 26 01:42:55.569077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 438/875] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:55 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:55.867424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c69a7773-22c8-4916-bf97-3f99fe7f84d7", "name": "network-vif-deleted", "tag": "73a4ae19-05f7-45db-a9b9-7d5ecba082d1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:42:55.877301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:55.877835 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:55.878265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:55.889680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] Creating event network-vif-deleted:73a4ae19-05f7-45db-a9b9-7d5ecba082d1 for instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 on hv-cinder-85920 Sep 26 01:42:55.895526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5477ddcf-fbe2-4dcc-8e04-bac76dd5af0d req-0e09ac96-26f0-4c7a-8415-bd9b924d8e97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Sep 26 01:42:55.896129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 438/876] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:42:56.090365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:56.092523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:56.100213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:56.100748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:56.101343 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:56.102343 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:56.102675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:56.103309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:56.136941 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:56.137426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:56.137884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:56.138503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lazy-loading 'fault' on Instance uuid c69a7773-22c8-4916-bf97-3f99fe7f84d7 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:42:56.185201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06043e862a394764a58003f205cbb484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3677555d86804f03ae243765cfd3fd24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:42:56.188826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:56.194364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9cfeb5be-2855-4f19-9dbb-7e7fa59abc15 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 200 len: 1328 microversion: 2.1 time: 0.110903 Sep 26 01:42:56.195022 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 439/877] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:56 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:42:57.220490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:57.221834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:42:57.227946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:57.228465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:57.228903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:57.229585 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:42:57.230034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:42:57.230451 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:42:57.233048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:42:57.245952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 HTTP/1.1 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:42:57.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:42:57.249323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c69a7773-22c8-4916-bf97-3f99fe7f84d7'} Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:42:57.250368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:42:57.252270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:42:57.253781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:42:57.253781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55d9a1e5-1666-4861-b76d-1b2ff85608fd tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 404 len: 111 microversion: 2.1 time: 0.034398 Sep 26 01:42:57.253781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 439/878] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:42:57 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:42:57.259109 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e59fe735-4513-457b-8c15-64657adcde43 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '.version_select at 0x7f29d3698160>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:42:57.278491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e59fe735-4513-457b-8c15-64657adcde43 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106403687" status: 202 len: 0 microversion: 2.1 time: 0.024197 Sep 26 01:42:57.279081 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 440/879] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Sep 26 01:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1106403687 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 01:43:00.156449 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:00.156953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:00.163570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:00.164057 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:00.164543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:00.165237 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:00.165692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:00.166121 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:00.179245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 HTTP/1.1 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:00.180821 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.182374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c69a7773-22c8-4916-bf97-3f99fe7f84d7'} Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:00.183370 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.184833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.186398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:00.186398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f0cdb2e-a92b-4a42-b5fe-434c4ee1624e tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 404 len: 111 microversion: 2.1 time: 0.029928 Sep 26 01:43:00.186398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 440/880] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:43:00 2022] DELETE /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:00.191825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:00.192460 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: c69a7773-22c8-4916-bf97-3f99fe7f84d7] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:00.199023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:00.199513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:00.199955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:00.200794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:00.201252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:00.201682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:00.215146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 HTTP/1.1 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:00.216823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.218351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'c69a7773-22c8-4916-bf97-3f99fe7f84d7'} Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:00.219238 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. Sep 26 01:43:00.220781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:00.222527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance c69a7773-22c8-4916-bf97-3f99fe7f84d7 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:00.222527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9c343fdb-551d-4abc-ae55-0d7c31a83d45 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7" status: 404 len: 111 microversion: 2.1 time: 0.031648 Sep 26 01:43:00.222527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 441/881] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:00 2022] GET /compute/v2.1/servers/c69a7773-22c8-4916-bf97-3f99fe7f84d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 01:43:01.356472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:01.356968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:01.364158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:01.364680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:01.365129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:01.365822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:01.366282 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:01.366707 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:01.380620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 HTTP/1.1 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:01.382148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.383745 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'b84bc271-dfaf-4aac-9c18-29b9202eec84'} Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:01.384773 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.386331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.388071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:01.388071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9425b205-0b74-4856-82ac-8a4059db3489 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 404 len: 111 microversion: 2.1 time: 0.030961 Sep 26 01:43:01.388071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 441/882] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:43:01 2022] DELETE /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:01.392014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:01.392690 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] [instance: b84bc271-dfaf-4aac-9c18-29b9202eec84] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:01.399227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:01.399704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:01.400132 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:01.400841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:01.401283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:01.401696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:01.417211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] HTTP exception thrown: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Request method failure captured: Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 HTTP/1.1 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIY_XphgcQyC2sBdeddIQE6W6qv7ktKF0mIxsJD0fKCJ_Ojlv0esBLkRtsxih_1pFMzuUOFnzvvD7MHa7M9A_XSD8fu3YVGIx2me3MPNbHjL6Bn75lnFg_V7RoRRHbtgugLrKnRv1yfj__QBoz6tg3NBfpxVjf6EYmWyncEf4pF_FI Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:01.418699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3677555d86804f03ae243765cfd3fd24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3677555d86804f03ae243765cfd3fd24", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 3677555d86804f03ae243765cfd3fd24 Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeTestJSON-502368830 Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 06043e862a394764a58003f205cbb484 Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeTestJSON-502368830-project Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.420298 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'b84bc271-dfaf-4aac-9c18-29b9202eec84'} Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:01.421230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. Sep 26 01:43:01.422715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:01.424619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] Returning 404 to user: Instance b84bc271-dfaf-4aac-9c18-29b9202eec84 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:01.424619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b70d347c-471f-46bc-9c32-08bf26194076 tempest-AttachVolumeTestJSON-502368830 tempest-AttachVolumeTestJSON-502368830-project] 10.222.0.25 "GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84" status: 404 len: 111 microversion: 2.1 time: 0.031851 Sep 26 01:43:01.424619 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 442/883] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:01 2022] GET /compute/v2.1/servers/b84bc271-dfaf-4aac-9c18-29b9202eec84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:05.693525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16c89f93-3fd7-47e0-9ea3-862c37dbb1b6 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Action: 'create', calling method: .version_select at 0x7f29d370d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-489707719", "metadata": {"Type": "work"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:05.982420 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16c89f93-3fd7-47e0-9ea3-862c37dbb1b6 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.403517 Sep 26 01:43:05.983185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 442/884] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Sep 26 01:43:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 01:43:05.996314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-faeb0998-997f-44ea-a065-bf26fcdca628 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d36af310>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:06.045964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-faeb0998-997f-44ea-a065-bf26fcdca628 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 200 len: 352 microversion: 2.1 time: 0.053294 Sep 26 01:43:06.046636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 443/885] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:05 2022] GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:07.061752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-537f1d7d-d363-4034-8dca-c879138ce2ee tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d38729d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:07.108551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-537f1d7d-d363-4034-8dca-c879138ce2ee tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 200 len: 353 microversion: 2.1 time: 0.050990 Sep 26 01:43:07.109085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 443/886] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:07 2022] GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:07.123201 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a4170aad-95da-4bf3-9819-3dd7b0fc58b4 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d37114c0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:07.170417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a4170aad-95da-4bf3-9819-3dd7b0fc58b4 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 200 len: 353 microversion: 2.1 time: 0.051750 Sep 26 01:43:07.170991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 444/887] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:07 2022] GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:07.189017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c85d2f0-a664-4adb-807b-ae3cebbe3b2b tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d370dd30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:07.248301 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c85d2f0-a664-4adb-807b-ae3cebbe3b2b tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 202 len: 0 microversion: 2.1 time: 0.062967 Sep 26 01:43:07.248901 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 444/888] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:43:07 2022] DELETE /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:43:07.257761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-29229906-e3a2-460d-8fa6-52a8ec1c3cfb tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d36e5820>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:07.307494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-29229906-e3a2-460d-8fa6-52a8ec1c3cfb tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 200 len: 352 microversion: 2.1 time: 0.053510 Sep 26 01:43:07.308053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 445/889] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:07 2022] GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:08.322289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e18aeab8-c957-4fbd-a2b2-61d368eeb9b5 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Calling method '.version_select at 0x7f29d3767790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:08.350319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e18aeab8-c957-4fbd-a2b2-61d368eeb9b5 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] HTTP exception thrown: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e18aeab8-c957-4fbd-a2b2-61d368eeb9b5 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Request method failure captured: Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 HTTP/1.1 Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQOpGOPPZ6np6nCOS7OhzZroOv8LkmpHhSJAvPKnGg4cJHZm0d5fNgPAcpedJEU-nzxVIBSBp2DuMMrZYQReCKgdy8s0HDLsWdwMsTFf2W3rCln6vFwRiOzoSgFdBYixnPgm18Ba7zJ39y0QTNWzWmieGH7j994Ziho8KW4t09pk_-I Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 341bfb664e114126b855c74373c93c0f Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesGetTestJSON-1386417237 Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:08.352219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/341bfb664e114126b855c74373c93c0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/341bfb664e114126b855c74373c93c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/341bfb664e114126b855c74373c93c0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_341bfb664e114126b855c74373c93c0f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-VolumesGetTestJSON-1386417237 Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 341bfb664e114126b855c74373c93c0f Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesGetTestJSON-1386417237 Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-VolumesGetTestJSON-1386417237-project Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: af6fc1d42016450ca9372e4f2ed6ce98 Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-VolumesGetTestJSON-1386417237-project Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'cab8b079-50d9-442d-ae6f-8337cdd11ad3'} Sep 26 01:43:08.353850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. (HTTP 404) (Request-ID: req-77a73e2e-7231-4e59-8f48-c773f99ed603) Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:08.354871 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 01:43:08.356280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 01:43:08.357933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e18aeab8-c957-4fbd-a2b2-61d368eeb9b5 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] Returning 404 to user: Volume cab8b079-50d9-442d-ae6f-8337cdd11ad3 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e18aeab8-c957-4fbd-a2b2-61d368eeb9b5 tempest-VolumesGetTestJSON-1386417237 tempest-VolumesGetTestJSON-1386417237-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3" status: 404 len: 109 microversion: 2.1 time: 0.035681 Sep 26 01:43:08.359336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 445/890] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:08 2022] GET /compute/v2.1/os-volumes/cab8b079-50d9-442d-ae6f-8337cdd11ad3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:09.679380 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:09.838884 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:09.845109 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:09.845669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:09.846147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:09.846953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:09.847401 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:09.847820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:09.877394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0595c5d1-fc4f-43d8-8d9a-b2165131cca0 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.201750 Sep 26 01:43:09.877945 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 446/891] 10.222.0.25 () {60 vars in 1343 bytes} [Mon Sep 26 01:43:09 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:09.946648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:09.947165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:09.953486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:09.953967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:09.954394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:09.955906 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:09.956549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:09.956976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:09.981335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:43:10.062152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af7715a7-83df-4dd2-bf67-dbc4505c4826 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 204 len: 0 microversion: 2.20 time: 0.120181 Sep 26 01:43:10.063106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 446/892] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Sep 26 01:43:09 2022] DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 01:43:10.073888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:10.075136 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:10.081546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:10.082026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:10.082449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:10.083336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:10.083781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:10.084197 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:10.218098 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:10.226606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:10.228116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:10.229371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4faa72b5-9b07-4264-9be6-b2ad3e42bfc2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.160910 Sep 26 01:43:10.229990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 447/893] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:10 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:43:11.257719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:11.258671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:11.265053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:11.265528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:11.265958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:11.266635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:11.267660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:11.268082 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:11.398993 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:11.407002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:11.409068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:11.410222 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0fd2034-1dc0-4162-981c-71be2315212d tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1723 microversion: 2.20 time: 0.156827 Sep 26 01:43:11.410781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 447/894] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:11 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 01:43:12.435676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:12.436394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:12.443735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:12.444310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:12.444859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:12.445632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:12.446184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:12.446695 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:12.476030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76df5cd-18f2-4253-a3ff-3ccdf78507a6", "name": "network-vif-deleted", "tag": "c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:12.491806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:12.492805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:12.493649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:12.509977 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] Creating event network-vif-deleted:c3bfb94e-8cdf-4145-8cd0-e4d8ed1b0b10 for instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 on hv-cinder-85920 Sep 26 01:43:12.523534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:12.526623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8689d4c7-6637-45c8-92bd-0a9687ba8b82 req-4d0ab79b-f5e9-465f-b637-8a2852a2b9b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049164 Sep 26 01:43:12.528230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 448/895] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:43:12.532826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:12.534351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc62747b8aab40d9bff9d853b9b73199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f78ca6e22f04c4ab911b2e308338517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:12.535524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-182a0177-4dd2-4445-8985-465da0fe6f82 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 200 len: 1655 microversion: 2.20 time: 0.104396 Sep 26 01:43:12.536089 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 448/896] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:12 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 01:43:13.568042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:13.568042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:13.574592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:13.575145 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:13.575656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:13.576551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:13.577115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:13.577589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:13.593183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 HTTP/1.1 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:13.594900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:13.597423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'b76df5cd-18f2-4253-a3ff-3ccdf78507a6'} Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:13.598363 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:13.600192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:13.601653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:13.601653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e858eec1-1ba1-464b-8298-4bfe66541622 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 404 len: 111 microversion: 2.20 time: 0.039617 Sep 26 01:43:13.601653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 449/897] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:13 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:43:13.608846 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45220ddc-e07f-4044-8a71-9f23eb0b25a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '.version_select at 0x7f29d368a820>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:13.628975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-45220ddc-e07f-4044-8a71-9f23eb0b25a2 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469762862" status: 204 len: 0 microversion: 2.20 time: 0.024021 Sep 26 01:43:13.629671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 449/898] 10.222.0.25 () {60 vars in 1259 bytes} [Mon Sep 26 01:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469762862 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 01:43:16.827294 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:16.827952 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:16.834013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:16.834498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:16.834991 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:16.835719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:16.836174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:16.836628 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:16.861353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59125e7c-68aa-4485-b95c-f6866fb06c02 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/ips" status: 200 len: 148 microversion: 2.1 time: 0.037555 Sep 26 01:43:16.869700 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 450/899] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:43:16 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:17.500042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:17.500595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:17.507223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:17.507696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:17.508134 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:17.508860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:17.509324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:17.509749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:17.522977 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 HTTP/1.1 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:17.524574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.526349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'b76df5cd-18f2-4253-a3ff-3ccdf78507a6'} Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:17.527317 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.528826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.530394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:17.530394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-342d53e8-f9c7-4bb6-8c90-e4bf87f649a6 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 404 len: 111 microversion: 2.20 time: 0.030463 Sep 26 01:43:17.530394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 450/900] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Sep 26 01:43:17 2022] DELETE /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:43:17.535221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:17.535851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: b76df5cd-18f2-4253-a3ff-3ccdf78507a6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:17.541784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:17.542266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:17.542703 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:17.543391 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:17.543844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:17.544266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:17.557957 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 HTTP/1.1 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:17.559466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.561143 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'b76df5cd-18f2-4253-a3ff-3ccdf78507a6'} Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:17.562144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. Sep 26 01:43:17.563667 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:17.565455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance b76df5cd-18f2-4253-a3ff-3ccdf78507a6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:17.565455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-067b2bf9-97c9-47eb-97a5-4c620bc17c08 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6" status: 404 len: 111 microversion: 2.20 time: 0.030206 Sep 26 01:43:17.565455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 451/901] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:17 2022] GET /compute/v2.1/servers/b76df5cd-18f2-4253-a3ff-3ccdf78507a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:43:18.257119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:18.259731 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:18.265661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.266229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.267448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.268230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.268730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.269156 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.518351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4fa58c7d-b5d7-46f6-806f-9a06a9305a72 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264350 Sep 26 01:43:18.518992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 451/902] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:43:18 2022] POST /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:18.703761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:18.704402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:18.710865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.711339 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.711764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.712472 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.712918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.713334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.726866 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 HTTP/1.1 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:43:18.728428 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.730101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '8390f758-83d5-4553-910b-5ec8bcb93ce6'} Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:18.731005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.732528 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.734065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:18.734065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1bed2f93-cb46-4236-b972-7fb38f961cf9 tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 404 len: 111 microversion: 2.20 time: 0.029853 Sep 26 01:43:18.734065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 452/903] 10.222.0.25 () {60 vars in 1280 bytes} [Mon Sep 26 01:43:18 2022] DELETE /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:43:18.739877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:18.740612 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] [instance: 8390f758-83d5-4553-910b-5ec8bcb93ce6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:18.746626 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.747179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.747533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.748214 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:18.748694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:18.749139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:18.764229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] HTTP exception thrown: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Request method failure captured: Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 HTTP/1.1 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQIWUknxju2mjpi-n6ZxM_MJlxJjWRRit92bqbRAvTGHPxMVdEZDNnuVujyPhjxpBq9llHYnZitl6xmxel7bg16eDjihei5EX8cVYbjdZx59HHY_NLBBp6SfC6SvgN5UOwN-u0ceR0WwWeVjd0wLfsY1LluLHtYYxMnZAKv3fJXAZgo Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:18.766421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f78ca6e22f04c4ab911b2e308338517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f78ca6e22f04c4ab911b2e308338517", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 2f78ca6e22f04c4ab911b2e308338517 Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-474288160 Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: bc62747b8aab40d9bff9d853b9b73199 Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeShelveTestJSON-474288160-project Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.768216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '8390f758-83d5-4553-910b-5ec8bcb93ce6'} Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:18.769160 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. Sep 26 01:43:18.770704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:18.772099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] Returning 404 to user: Instance 8390f758-83d5-4553-910b-5ec8bcb93ce6 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:18.772099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-92e8e4eb-ca09-40bc-82f2-049d32b86c2e tempest-AttachVolumeShelveTestJSON-474288160 tempest-AttachVolumeShelveTestJSON-474288160-project] 10.222.0.25 "GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6" status: 404 len: 111 microversion: 2.20 time: 0.033665 Sep 26 01:43:18.772099 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 452/904] 10.222.0.25 () {60 vars in 1277 bytes} [Mon Sep 26 01:43:18 2022] GET /compute/v2.1/servers/8390f758-83d5-4553-910b-5ec8bcb93ce6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:43:24.898298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4622c47-55db-4710-a37c-b65b161c221e tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d38728b0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:24.949001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4622c47-55db-4710-a37c-b65b161c221e tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/fb4e2487-83e0-4191-a600-7a69e8a7cc60" status: 200 len: 351 microversion: 2.1 time: 0.054335 Sep 26 01:43:24.949563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 453/905] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:24 2022] GET /compute/v2.1/os-volumes/fb4e2487-83e0-4191-a600-7a69e8a7cc60 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:25.102836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-15132aa1-a03e-43f7-b00f-c862fff13779 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: .version_select at 0x7f29d3715310>, body: {"keypair": {"name": "tempest-keypair-698508038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+JnNAGe748+Wt9unhVMUEHzNzmJUWM81JFJLNShBuiOHcYmo/Gy8JX3Die3pwNOCk6mTLymT8mQaLhpQvVXjDh+r78eWGTeQKqwWqYG5kjS/bM5v5rNsXNKKIu4O+JmA=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:25.109442 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:25.123869 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-15132aa1-a03e-43f7-b00f-c862fff13779 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:43:25.128118 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-15132aa1-a03e-43f7-b00f-c862fff13779 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:43:25.151139 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-15132aa1-a03e-43f7-b00f-c862fff13779 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052022 Sep 26 01:43:25.151846 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 453/906] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:43:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:26.373597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9882bfd-b37c-49a4-bece-f25e0dc1437f tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d386ad30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:26.423983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9882bfd-b37c-49a4-bece-f25e0dc1437f tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b7bfc1d8-911d-46a5-860c-9462e25752c5" status: 200 len: 350 microversion: 2.1 time: 0.054692 Sep 26 01:43:26.424674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 454/907] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:26 2022] GET /compute/v2.1/os-volumes/b7bfc1d8-911d-46a5-860c-9462e25752c5 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:26.496801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1464568234", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f9f02f3-760e-48dc-b09d-e8f3d058e4c5"}], "security_groups": [{"name": "tempest-securitygroup--1391278943"}], "key_name": "tempest-keypair-698508038", "user_data": "}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:26.606326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] validate_networks() for [('3f9f02f3-760e-48dc-b09d-e8f3d058e4c5', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:43:27.380559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:43:27.381057 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:43:27.381524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:43:27.381956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:43:27.382360 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:43:27.391169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:27.391956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:27.392419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:27.393328 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:27.393758 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:27.394247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:27.401645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:27.417213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:43:27.421289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:43:27.433585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:43:27.435885 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:43:27.488805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e4eff3d2-c76b-4ea8-b2c1-5f5b0cbcc120 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.996750 Sep 26 01:43:27.489456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 454/908] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:43:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:43:27.501660 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4eea6f4e-ba11-4d03-8d2f-cbb83568ed7e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:27.502417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4eea6f4e-ba11-4d03-8d2f-cbb83568ed7e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:27.505552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:27.562597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4eea6f4e-ba11-4d03-8d2f-cbb83568ed7e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:27.571352 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4eea6f4e-ba11-4d03-8d2f-cbb83568ed7e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1241 microversion: 2.1 time: 0.074359 Sep 26 01:43:27.571927 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 455/909] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:27 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:27.838704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0ee3653b-dbc3-45f9-b0a3-d3aeecfb0dcd tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d37a38b0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:27.906308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0ee3653b-dbc3-45f9-b0a3-d3aeecfb0dcd tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/69817910-0520-40bb-b23b-93d4671adf52" status: 200 len: 349 microversion: 2.1 time: 0.071592 Sep 26 01:43:27.907735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 455/910] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Sep 26 01:43:27 2022] GET /compute/v2.1/os-volumes/69817910-0520-40bb-b23b-93d4671adf52 => generated 349 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:27.920974 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bcbc84cd-801f-4ba0-8f3b-c18a6a569ade tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d386a550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.015411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bcbc84cd-801f-4ba0-8f3b-c18a6a569ade tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.098154 Sep 26 01:43:28.020385 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 456/911] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Sep 26 01:43:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:28.034053 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4f57f9bd-9ad5-4965-b764-8257533f723f tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d37b0c10>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.132270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4f57f9bd-9ad5-4965-b764-8257533f723f tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.102322 Sep 26 01:43:28.132916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 456/912] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:28.149485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b10b0ad-51be-4ed2-8c05-368fb2c53060 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d384baf0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.243792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b10b0ad-51be-4ed2-8c05-368fb2c53060 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.098010 Sep 26 01:43:28.244522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 457/913] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:43:28.258528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2e340846-fa8e-4f96-b83e-e84840c61bd6 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d37a3c10>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.348333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2e340846-fa8e-4f96-b83e-e84840c61bd6 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093476 Sep 26 01:43:28.348955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 457/914] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:43:28.363201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4549e6ee-0309-4563-a743-595cca77be83 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d3872d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.450422 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4549e6ee-0309-4563-a743-595cca77be83 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.091379 Sep 26 01:43:28.451060 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 458/915] 10.222.0.25 () {58 vars in 1170 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:43:28.464883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-507f474a-253a-4706-a6b7-1019f7749dcb tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d3753670>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.546323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-507f474a-253a-4706-a6b7-1019f7749dcb tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085127 Sep 26 01:43:28.546892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 458/916] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:28.565068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a2c8e19-998f-45aa-82ce-8de020624865 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d386a820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.595947 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.596716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:28.604375 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:28.604865 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:28.605299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:28.606632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:28.607272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:28.607860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:28.681218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:28.690856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d7384d67-b818-4b3c-a3c2-d5df3ef75996 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1293 microversion: 2.1 time: 0.099450 Sep 26 01:43:28.691756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 459/917] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:43:28.697205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a2c8e19-998f-45aa-82ce-8de020624865 tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136761 Sep 26 01:43:28.697811 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 459/918] 10.222.0.25 () {58 vars in 1188 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:28.718914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-95c4a8e1-7946-4229-915f-98fe8e83827d tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] Calling method '.version_select at 0x7f29d368adc0>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:28.827981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-95c4a8e1-7946-4229-915f-98fe8e83827d tempest-VolumesTestJSON-422386879 tempest-VolumesTestJSON-422386879-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.113008 Sep 26 01:43:28.828898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 460/919] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Sep 26 01:43:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:29.717261 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:29.718139 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:29.726061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:29.729087 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:29.729850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:29.731083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:29.733996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:29.735659 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:29.736209 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:29.968760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:29.977779 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5bbe5c97-7e07-4959-835d-648652ea4861 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.266076 Sep 26 01:43:29.978467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 460/920] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:29 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:30.356957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2665e6-6873-4c15-8efc-65665e9a6a5a", "tag": "ff646199-ff50-466a-aaa1-0699748e2a21"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:30.370958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:30.371607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:30.372321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:30.384902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] Creating event network-changed:ff646199-ff50-466a-aaa1-0699748e2a21 for instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a on hv-cinder-85920 Sep 26 01:43:30.389783 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-94152248-cdac-40af-bc8b-36617fa65cd1 req-21377298-27bb-4936-8d83-ac4f239bf61f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038796 Sep 26 01:43:30.390389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 461/921] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:31.002616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:31.003231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:31.009591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:31.010068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:31.010498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:31.011175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:31.011622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:31.012038 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:31.144517 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:31.152273 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0bac11be-a3f7-4413-816d-96482d675670 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.153837 Sep 26 01:43:31.152859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 461/922] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:30 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:32.176191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:32.176911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:32.183513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:32.183993 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:32.184449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:32.185149 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:32.185579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:32.186004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:32.321634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:32.329649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5948fb09-1eeb-4e70-95ad-3b11714c7ce8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.158186 Sep 26 01:43:32.330221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 462/923] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:32 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:33.354310 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:33.355491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:33.362951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:33.363740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:33.364246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:33.365004 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:33.365725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:33.366426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:33.522525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:33.530266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2777467b-abfd-42bb-bc78-b022b8843286 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.180772 Sep 26 01:43:33.531270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 462/924] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:33 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:34.554429 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:34.555936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:34.566831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:34.567799 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:34.568553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:34.569542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:34.570233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:34.570876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:34.762367 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2665e6-6873-4c15-8efc-65665e9a6a5a", "name": "network-vif-plugged", "status": "completed", "tag": "ff646199-ff50-466a-aaa1-0699748e2a21"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:34.773715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:34.774967 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:34.775662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:34.776257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:34.786744 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-188fcace-b786-400b-acff-498c6072aad5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.236377 Sep 26 01:43:34.787293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 463/925] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:34 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:34.801128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] Creating event network-vif-plugged:ff646199-ff50-466a-aaa1-0699748e2a21 for instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a on hv-cinder-85920 Sep 26 01:43:34.810434 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ae97aa50-4515-420e-9104-c9dc9b0f9422 req-c5751689-4ef9-43bf-896e-a2ab9fc8d5b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052608 Sep 26 01:43:34.812092 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 463/926] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:43:35.814245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:35.814891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:35.822422 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:35.823006 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:35.823444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:35.824140 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:35.824613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:35.825030 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:35.972060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:35.979832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-545e9c6a-e37f-4012-a5a1-1e6c475d6c0a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1367 microversion: 2.1 time: 0.170440 Sep 26 01:43:35.980416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 464/927] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:35 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:37.004569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:37.004569 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:37.011335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:37.012051 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:37.012630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:37.013459 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:37.013988 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:37.014469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:37.153178 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:37.162196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-183e627c-aec0-475e-a854-3fc6249f167f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1556 microversion: 2.1 time: 0.162981 Sep 26 01:43:37.162791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 464/928] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:36 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:37.185373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:37.185873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:37.193410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:37.193864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:37.194304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:37.195145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:37.195604 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:37.196025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:37.286741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f12789c7-235e-4550-848a-12d78c3f6ff3 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105048 Sep 26 01:43:37.287434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 465/929] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:43:37 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:38.410096 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:38.734316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2665e6-6873-4c15-8efc-65665e9a6a5a", "tag": "ff646199-ff50-466a-aaa1-0699748e2a21"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:38.746431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:38.747159 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:38.747697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:38.761335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] Creating event network-changed:ff646199-ff50-466a-aaa1-0699748e2a21 for instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a on hv-cinder-85920 Sep 26 01:43:38.767855 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92dd9ebf-3923-493c-ac58-195c93ef74a8 req-3e3cf20a-4da6-442b-bd6a-0172b865b5dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363657 Sep 26 01:43:38.768923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 465/930] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:41.305221 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:41.306025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=10 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:41.310375 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1563737396", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:41.365398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] validate_networks() for None {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:43:41.634948 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:43:41.635364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:43:41.635831 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:43:41.636262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:43:41.636701 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:43:41.645554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:41.646023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:41.646450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:41.647187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:41.647637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:41.648052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:41.664557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Getting quotas for project 10895902ec774f7ab15db01ce507471d. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:43:41.668476 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Getting quotas for user 21d71eca7714406d8f97c061d6b26ce9 and project 10895902ec774f7ab15db01ce507471d. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:43:41.679654 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:43:41.681944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:43:41.733345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6d99c658-63bb-4af9-9060-ea73bec11c20 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428857 Sep 26 01:43:41.734029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 466/931] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:43:41.746332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10cf77b7-cdf7-4b18-a4b6-1213bdba9e7c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:41.747033 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10cf77b7-cdf7-4b18-a4b6-1213bdba9e7c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:41.801365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-10cf77b7-cdf7-4b18-a4b6-1213bdba9e7c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:41.808819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10cf77b7-cdf7-4b18-a4b6-1213bdba9e7c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1215 microversion: 2.1 time: 0.067206 Sep 26 01:43:41.809382 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 466/932] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:41 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:42.834452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:42.835218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:42.842315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:42.842817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:42.843461 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:42.844408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:42.844825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:42.845391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:42.938250 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:42.947547 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ca4bc835-91a2-4bec-9134-d3ecfbfbe242 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1275 microversion: 2.1 time: 0.118197 Sep 26 01:43:42.948423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 467/933] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:42 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:43.976204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:43.976752 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:43.985537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:43.986164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:43.986802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:43.987672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:43.988380 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:43.989078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:44.203498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:44.212684 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22b8b4b0-f398-4618-bd08-dc882eb2a6cc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.241126 Sep 26 01:43:44.213405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 467/934] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:43 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:44.475267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebcf9d0c-a483-4d42-9490-a05d36e09407", "tag": "77f0263d-cce9-48b5-acf1-5862e14054fd"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:44.488016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:44.488807 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:44.489972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:44.506274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] Creating event network-changed:77f0263d-cce9-48b5-acf1-5862e14054fd for instance ebcf9d0c-a483-4d42-9490-a05d36e09407 on hv-cinder-85920 Sep 26 01:43:44.511531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-c66a086a-02af-4f16-916d-099c5a470165 req-4fae795a-72f5-45e4-b567-973bdd3761fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040627 Sep 26 01:43:44.512198 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 468/935] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:45.238058 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:45.238672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:45.245732 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:45.246445 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:45.246883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:45.247584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:45.248090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:45.248530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:45.386105 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:45.395661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c1bcc889-6e70-441a-b774-77d901093363 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.162632 Sep 26 01:43:45.396242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 468/936] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:45 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:46.419974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:46.421038 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:46.436023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:46.436550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:46.437171 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:46.437875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:46.438329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:46.439008 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:46.759402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:46.773188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-24d49e6f-d574-4ef0-80fa-214f768358a2 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.357780 Sep 26 01:43:46.777304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 469/937] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:46 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:47.799171 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:47.799999 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:47.807624 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:47.808696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:47.809394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:47.810764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:47.811498 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:47.812832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:47.964250 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:47.973763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-978ac871-2c7c-498c-bcd4-5202ceb51f89 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.178913 Sep 26 01:43:47.974471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 469/938] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:47 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:48.044658 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:48.045796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:48.052892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:48.054274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:48.054984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:48.055721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:48.056316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:48.056824 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:48.088164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:43:48.184252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8ec3d7ba-9177-4b8a-8fc8-9ec72439cd7b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 204 len: 0 microversion: 2.1 time: 0.143485 Sep 26 01:43:48.184964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 470/939] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:43:48 2022] DELETE /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 01:43:48.194050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:48.194978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:48.200981 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:48.201541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:48.202040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:48.203357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:48.203874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:48.204592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:48.356621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:48.368557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-458f1af3-5d80-4059-b2f2-9803b7daf093 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1580 microversion: 2.1 time: 0.178156 Sep 26 01:43:48.369410 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 470/940] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:48 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1580 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:48.998989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:49.000316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:49.007082 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:49.007882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:49.009027 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:49.010287 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:49.010737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:49.011321 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:49.163887 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcf9d0c-a483-4d42-9490-a05d36e09407", "name": "network-vif-plugged", "status": "completed", "tag": "77f0263d-cce9-48b5-acf1-5862e14054fd"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:49.172284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:49.176335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:49.177354 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:49.178187 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:49.184500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2ed0801b-e787-46bc-b3f6-f731094234dc tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.188347 Sep 26 01:43:49.185481 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 471/941] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:48 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:49.210924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] Creating event network-vif-plugged:77f0263d-cce9-48b5-acf1-5862e14054fd for instance ebcf9d0c-a483-4d42-9490-a05d36e09407 on hv-cinder-85920 Sep 26 01:43:49.215944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e0c94782-fabc-4892-a87d-afe47fde3d9b req-f8b771d2-bbe4-4c47-bd72-90c353444da6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056012 Sep 26 01:43:49.216570 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 471/942] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:49.394260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:49.395233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:49.401510 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:49.402316 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:49.402986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:49.403939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:49.404525 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:49.405162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:49.602845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:49.614715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-78c744dc-5172-4721-9396-3084c00360eb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1580 microversion: 2.1 time: 0.222811 Sep 26 01:43:49.615545 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 472/943] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:49 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1580 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:50.213864 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:50.215107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:50.222683 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:50.223179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:50.223621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:50.224432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:50.224802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:50.225452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:50.473430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:50.486523 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6a21c67-8135-4f4b-8092-e2ce4da1e001 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1315 microversion: 2.1 time: 0.277244 Sep 26 01:43:50.487109 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 472/944] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:50 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:50.642837 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:50.643488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:50.661541 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:50.662291 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:50.662932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:50.664013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:50.673989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:50.675055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:50.947490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:50.979348 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-35581bcc-0baf-43d5-a170-eb0c72d755f2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1580 microversion: 2.1 time: 0.338470 Sep 26 01:43:50.981606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 473/945] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:50 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1580 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:51.369609 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86741c60-35b0-4105-9c2d-3f667824cd4d", "name": "network-vif-deleted", "tag": "729940fc-9c6b-495b-994b-02d51a549f20"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:51.392497 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:51.394973 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:51.395685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:51.426850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] Creating event network-vif-deleted:729940fc-9c6b-495b-994b-02d51a549f20 for instance 86741c60-35b0-4105-9c2d-3f667824cd4d on hv-cinder-85920 Sep 26 01:43:51.457179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2e8e0bca-921f-4a91-bcec-e8d1d9debdb0 req-5fdd2659-933d-4019-ad13-20a0651428e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095303 Sep 26 01:43:51.461884 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 473/946] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:43:51.510087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:51.510715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:51.521338 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:51.522163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:51.523192 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:51.524110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:51.526423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:51.527073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:51.656687 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:51.676237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:51.779691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:51.788670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-472024dd-4113-403e-8451-cd26d28c7518 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1465 microversion: 2.1 time: 0.283220 Sep 26 01:43:51.792867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 474/947] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:51 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1465 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:51.858663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:51.866648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:51.867384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:51.881698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:51.887966 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:51.888852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:51.890243 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:51.890975 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:51.891663 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:51.929581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:43:52.009454 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:52.010490 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:52.020028 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:52.021712 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:52.022356 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:52.023676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:52.024464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:52.025169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:52.099388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:52.100131 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:52.100821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:52.102273 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lazy-loading 'fault' on Instance uuid 86741c60-35b0-4105-9c2d-3f667824cd4d {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:43:52.132030 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3bcea3d-59f6-4f78-8b74-146ae9ff98ba tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 204 len: 0 microversion: 2.1 time: 0.271061 Sep 26 01:43:52.136470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 474/948] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:43:51 2022] DELETE /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:43:52.145381 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:52.146083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:52.159605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:52.162150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:52.162815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:52.164274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:52.164924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:52.165509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:52.186253 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:52.199156 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c49c732a-f85a-459f-bc9a-9bfe6689fe10 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1231 microversion: 2.1 time: 0.197030 Sep 26 01:43:52.220926 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 475/949] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:52 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1231 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:43:52.336067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:52.346203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad643ff4-a8d3-4b58-b92d-311923ae9bdd tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1471 microversion: 2.1 time: 0.207522 Sep 26 01:43:52.347218 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 475/950] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:52 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:53.227995 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:53.229419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:53.239183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:53.240001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:53.240809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:53.241768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:53.242421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:53.244641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:53.299410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:53.300047 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:53.300631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:53.301311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lazy-loading 'fault' on Instance uuid 86741c60-35b0-4105-9c2d-3f667824cd4d {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:43:53.303656 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:53.372600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:53.373215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:53.375329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:53.380362 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:53.381115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:53.381709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:53.382565 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:53.383241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:53.383875 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:53.386575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-89a32c09-f008-40c1-914e-14246d1acfcb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 200 len: 1231 microversion: 2.1 time: 0.165077 Sep 26 01:43:53.400033 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 476/951] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:53 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 1231 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:53.612540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:53.626584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47138258-d9b0-4fed-b265-3d0be58b5a9c tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1471 microversion: 2.1 time: 0.257720 Sep 26 01:43:53.632152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 476/952] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:53 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:54.416446 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:54.418034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:54.425106 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.425914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.426672 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.427696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.428217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.428736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.446278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] HTTP exception thrown: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Request method failure captured: Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d HTTP/1.1 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQMoI6BfgIrnFHyNozyJGTjRJM83LNx28IVsWDFwxuHaogVOg_NB8ydQs9re6B_-AU8mj2YezohnKCaNtfXj9dauu90r8jids35H5l0ZqFzD1fOH1mJcmgev75mek1tYFNTGso8MJxIFSxzHWQOiUfJhKGAqg_wpswHSz4oZK0BR_ro Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:54.448045 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/786ed33f027946f581147e672b947df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_786ed33f027946f581147e672b947df0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-TestVolumeBootPattern-348240511 Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: a47ec612bce54bc8b2062b03d36d10d4 Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:43:54.449870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '86741c60-35b0-4105-9c2d-3f667824cd4d'} Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:54.450845 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:43:54.452634 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:54.453995 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Returning 404 to user: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:54.454913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a839e955-914e-4230-ba61-3a3d9186fde2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 404 len: 111 microversion: 2.1 time: 0.044644 Sep 26 01:43:54.457186 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 477/953] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:54 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:54.593702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1769566980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1126381645", "security_groups": [{"name": "tempest-secgroup-smoke-1718875407"}], "block_device_mapping_v2": [{"uuid": "6aed11c5-7a98-4988-b296-f8a98473259d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9880eab6-c89c-4490-9622-c91f1df8e6a8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:54.613927 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebcf9d0c-a483-4d42-9490-a05d36e09407", "name": "network-vif-deleted", "tag": "77f0263d-cce9-48b5-acf1-5862e14054fd"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:43:54.646458 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.646945 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.649579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.694286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] Creating event network-vif-deleted:77f0263d-cce9-48b5-acf1-5862e14054fd for instance ebcf9d0c-a483-4d42-9490-a05d36e09407 on hv-cinder-85920 Sep 26 01:43:54.721967 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-5371f83b-8368-4095-9a26-59e10a37f953 req-b6dbac3d-ebf1-4750-afd0-b6dcd4f23619 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113703 Sep 26 01:43:54.722575 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 478/954] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:43:54.734715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:54.752377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:54.769444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.770254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.770871 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.771777 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.772426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.773014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.836104 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:54.836653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:54.837070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:54.839452 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lazy-loading 'fault' on Instance uuid ebcf9d0c-a483-4d42-9490-a05d36e09407 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:43:54.890704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] validate_networks() for [('9880eab6-c89c-4490-9622-c91f1df8e6a8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:43:54.915267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d71eca7714406d8f97c061d6b26ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10895902ec774f7ab15db01ce507471d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:54.924052 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f002afc8-260a-4836-ae30-53c4392daf3d tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 200 len: 1305 microversion: 2.1 time: 0.194312 Sep 26 01:43:54.935043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 479/955] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:54 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:55.935289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:43:55.935289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:43:55.935289 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:43:55.937949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:43:55.938769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:43:55.948767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:55.950003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] [instance: ebcf9d0c-a483-4d42-9490-a05d36e09407] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:55.958007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:55.958502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:55.959111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:55.960820 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:55.963216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:55.963366 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:55.963805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:55.973073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:55.974980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:55.978759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:55.980867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:55.982830 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:55.984615 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:55.989794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:43:55.994557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for user a47ec612bce54bc8b2062b03d36d10d4 and project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:43:56.020740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] HTTP exception thrown: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Request method failure captured: Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 HTTP/1.1 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQPLe6FoPp3_uOYm3F89kaquKMc3I237W17WHp_S24TX1X8uPlSEX59U5k4C685BUFgTQG2uMIZ9mhNJWngLHwathVgMCkwyVOARs7XdK1E1VMgBEO2xt98TuVedR2Bhl5otTsUbJMPzJefiOQqpMofHpPPYQZoIo9iKe8UyfDCP1B8 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 10895902ec774f7ab15db01ce507471d Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-VolumesNegativeTest-1449257193 Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:43:56.022421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10895902ec774f7ab15db01ce507471d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/10895902ec774f7ab15db01ce507471d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/10895902ec774f7ab15db01ce507471d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_10895902ec774f7ab15db01ce507471d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-VolumesNegativeTest-1449257193 Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 10895902ec774f7ab15db01ce507471d Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-VolumesNegativeTest-1449257193 Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-VolumesNegativeTest-1449257193-project Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 21d71eca7714406d8f97c061d6b26ce9 Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-VolumesNegativeTest-1449257193-project Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. Sep 26 01:43:56.023757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'ebcf9d0c-a483-4d42-9490-a05d36e09407'} Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:43:56.024596 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. Sep 26 01:43:56.025953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:43:56.027075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] Returning 404 to user: Instance ebcf9d0c-a483-4d42-9490-a05d36e09407 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:43:56.027075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-78b03845-b4a5-485d-ac9e-833761115da9 tempest-VolumesNegativeTest-1449257193 tempest-VolumesNegativeTest-1449257193-project] 10.222.0.25 "GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407" status: 404 len: 111 microversion: 2.1 time: 0.081478 Sep 26 01:43:56.027075 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 480/956] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:55 2022] GET /compute/v2.1/servers/ebcf9d0c-a483-4d42-9490-a05d36e09407 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:43:56.097112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:43:56.099961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aed11c5-7a98-4988-b296-f8a98473259d',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:43:56.335549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53a2120a-c61c-4615-8cbe-b0cdb1a02594 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.747983 Sep 26 01:43:56.336756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 477/957] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:43:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:43:56.365029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0b58c779-7139-4ecc-82e6-05764cd82245 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:56.366492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0b58c779-7139-4ecc-82e6-05764cd82245 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:56.450391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0b58c779-7139-4ecc-82e6-05764cd82245 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:56.458976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0b58c779-7139-4ecc-82e6-05764cd82245 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1095 microversion: 2.1 time: 0.114570 Sep 26 01:43:56.459562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 481/958] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:56 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:57.490721 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:57.495701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:57.511381 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:57.511880 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:57.512333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:57.513067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:57.513522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:57.513951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:57.599230 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:57.608841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0b2623c-28f9-4315-8c06-f7cd53820ed3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1193 microversion: 2.1 time: 0.128384 Sep 26 01:43:57.609477 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 478/959] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:57 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:58.644827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:58.645514 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:58.667162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:58.667678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:58.668120 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:58.671856 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:58.672387 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:58.672833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:58.791260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:43:58.805475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-458c2470-b651-4927-b704-2b44977056b8 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1211 microversion: 2.1 time: 0.173161 Sep 26 01:43:58.807003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 482/960] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:58 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:43:59.835133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:43:59.835914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:43:59.838657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:43:59.854802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:59.856900 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:59.858334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:59.864155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:43:59.865153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:43:59.865898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:43:59.886137 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:00.365136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:00.390361 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8cecf7f7-f119-42a8-8c81-3071a70a26a2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.560916 Sep 26 01:44:00.390949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 479/961] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:43:59 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:00.740747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad4ef30-98fb-408a-8a13-e78e64481234", "tag": "8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:00.756550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:00.761209 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:00.763111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:00.794133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] Creating event network-changed:8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8 for instance 2ad4ef30-98fb-408a-8a13-e78e64481234 on hv-cinder-85920 Sep 26 01:44:00.807185 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-3b31bf53-ddf4-48e2-9f9d-d31080e52e22 req-d8cc8fe8-fa55-472e-a741-d98126f92017 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070105 Sep 26 01:44:00.807909 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 483/962] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:01.424976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:01.427267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:01.445611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:01.447091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:01.448210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:01.450221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:01.451499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:01.452949 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:01.891799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:01.901792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3668ab5-b313-48ab-997f-22d1b800f9fc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.488313 Sep 26 01:44:01.907899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 480/963] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:01 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:02.946794 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:02.948393 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:02.957013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:02.960011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:02.960633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:02.962803 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:02.964610 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:02.965107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:03.161048 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:03.171314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a447d12f-45f1-481a-9b67-8f8160fb28b4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.243130 Sep 26 01:44:03.172554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 484/964] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:02 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:04.195297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:04.196255 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:04.204017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:04.204614 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:04.205123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:04.205898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:04.206600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:04.207235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:04.353002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:04.362045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-920eb9ab-e67d-4b12-ae17-9fc044392d46 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.170613 Sep 26 01:44:04.362623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 481/965] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:04 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:05.385116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:05.385688 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:05.393043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:05.393805 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:05.394247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:05.394942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:05.395400 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:05.395827 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:05.540842 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:05.548841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0fd17bc3-5c61-481e-9143-a14f34f485fd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.167621 Sep 26 01:44:05.564370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 485/966] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:05 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:06.572282 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:06.573046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:06.577162 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:06.577822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:06.584064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:06.584620 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:06.585065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:06.585788 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:06.586238 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:06.586665 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:06.734050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:06.742534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8fbedef-3de5-4cc1-bee5-671c9e0ba6a7 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.173880 Sep 26 01:44:06.747028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 482/967] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:06 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:07.770710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:07.771318 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:07.773747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:07.778479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:07.778959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:07.779925 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:07.780643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:07.781090 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:07.781506 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:07.929003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:07.937802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8cc0356a-ba98-4066-b2c3-012b09eebdc6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.170338 Sep 26 01:44:07.937802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 486/968] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:07 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:08.396956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c802dc9-0066-446e-a236-e48b7cc95efd tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'create', calling method: .version_select at 0x7f29d369f550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1755112190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLks5A30nbykowKygWA2DkruFsIC/3mphf+kODhx0PDSgkQIFbFc/dvSSCwmV477qjBc8LwjiBl4yFhDTWzUnaJ2eIz0Z21dzjQKhPkT/SLKQLfkS7tSA6/9BPCZ0C6NUw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:08.413204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-2c802dc9-0066-446e-a236-e48b7cc95efd tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Getting quotas for project 63b4276ece354a06b400b45e9e49186b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:44:08.417463 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-2c802dc9-0066-446e-a236-e48b7cc95efd tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Getting quotas for user e1d3321cdb59406da03c91fd8ec71885 and project 63b4276ece354a06b400b45e9e49186b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:44:08.439431 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c802dc9-0066-446e-a236-e48b7cc95efd tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046279 Sep 26 01:44:08.440017 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 483/969] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:44:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:08.569901 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-821612213", "imageRef": "2d470a88-de51-4dbb-ad19-57935b3d44a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1755112190", "networks": [{"uuid": "6109f9fe-7dc9-4599-b93f-6fcbe6418d6c"}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:08.621797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] validate_networks() for [('6109f9fe-7dc9-4599-b93f-6fcbe6418d6c', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:44:08.960235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:08.960923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:08.968022 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:08.968560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:08.968998 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:08.969714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:08.970190 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:08.970610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:09.021823 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:44:09.022340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:44:09.023006 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:44:09.023413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:44:09.023816 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:44:09.033770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:09.034398 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:09.034697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:09.036444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:09.036444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:09.036444 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:09.058276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Getting quotas for project 63b4276ece354a06b400b45e9e49186b. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:44:09.062876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Getting quotas for user e1d3321cdb59406da03c91fd8ec71885 and project 63b4276ece354a06b400b45e9e49186b. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:44:09.079862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:44:09.082146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d470a88-de51-4dbb-ad19-57935b3d44a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:44:09.146462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e2afc0c3-e5e9-4b89-8f7e-6535b2e03443 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580214 Sep 26 01:44:09.148178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 487/970] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:44:09.162963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f8895823-d0d5-41ac-a99b-291667ef4372 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:09.164041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f8895823-d0d5-41ac-a99b-291667ef4372 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:09.400215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f8895823-d0d5-41ac-a99b-291667ef4372 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:09.411791 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f8895823-d0d5-41ac-a99b-291667ef4372 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1258 microversion: 2.1 time: 0.255813 Sep 26 01:44:09.413153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 488/971] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:09 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:09.429808 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:09.438649 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f01c43b-b2df-40cb-80d6-5db4f33d308e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.482184 Sep 26 01:44:09.452524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 484/972] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:08 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:10.436101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:10.437712 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:10.444504 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:10.445072 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:10.445592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:10.446391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:10.447060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:10.447700 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:10.461357 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:10.462617 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:10.470320 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:10.471176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:10.471829 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:10.472789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:10.473446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:10.474220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:10.535009 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:10.546889 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-36220251-5191-415d-99fb-cd451a1b83f4 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1328 microversion: 2.1 time: 0.114899 Sep 26 01:44:10.547642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 489/973] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:10 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:10.702805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:10.714510 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e870a73-7e5f-4d8b-8cda-3cd3784ca0d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.256786 Sep 26 01:44:10.716323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 485/974] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:10 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:10.872336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad4ef30-98fb-408a-8a13-e78e64481234", "name": "network-vif-plugged", "status": "completed", "tag": "8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:10.889963 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:10.890508 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:10.890953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:10.908730 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] Creating event network-vif-plugged:8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8 for instance 2ad4ef30-98fb-408a-8a13-e78e64481234 on hv-cinder-85920 Sep 26 01:44:10.917203 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-8586bf3c-87ca-4e66-99aa-c00e01c16f81 req-a4093c7a-c4b2-4a51-8ae4-5adcd01d49e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048819 Sep 26 01:44:10.918110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 490/975] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:11.570840 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:11.571611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:11.578465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:11.579058 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:11.579566 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:11.580361 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:11.580824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:11.581284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:11.725558 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:11.738184 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-732233c4-d6e2-4879-885c-c678ed2d8077 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.171385 Sep 26 01:44:11.738776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 486/976] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:11 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:11.740996 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:11.748448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:11.755297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:11.755919 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:11.756521 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:11.757499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:11.758154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:11.758811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:11.908988 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:11.916742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a0694e88-baf8-402a-a3c7-235f81d903c6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.181015 Sep 26 01:44:11.917561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 491/977] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:11 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:12.762518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:12.763136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:12.769748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:12.770539 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:12.770976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:12.771680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:12.772136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:12.772597 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:12.910846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:12.918605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb8a5084-8be2-4092-b2cd-f73e95aab715 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.160038 Sep 26 01:44:12.919174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 487/978] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:12 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:12.940667 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:12.941305 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:12.947733 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:12.948223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:12.948693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:12.949390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:12.949843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:12.950267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:13.098748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:13.106699 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b2720aaa-d92c-4172-820a-f659a9a1a262 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.170129 Sep 26 01:44:13.108133 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 492/979] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:12 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:13.943071 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:13.943662 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:13.950042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:13.950531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:13.951730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:13.952704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:13.953157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:13.953580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:14.093950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:14.103598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a515037b-0f46-4640-9a6a-889c99391615 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.164450 Sep 26 01:44:14.107901 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 488/980] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:13 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:14.131264 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:14.131945 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:14.140958 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:14.141303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:14.141780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:14.142486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:14.143331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:14.143331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:14.325168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:14.336085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-861e3853-3133-4c47-a4eb-accb9a9bf4c5 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.209085 Sep 26 01:44:14.336702 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 493/981] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:14 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:14.969031 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:14.969696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:14.976204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:14.976757 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:14.977192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:14.977897 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:14.978351 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:14.978778 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.004254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6b62170-b50c-406f-9a96-0af1b296750f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/ips" status: 200 len: 148 microversion: 2.1 time: 0.039217 Sep 26 01:44:15.005042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 489/982] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:44:14 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:15.016715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:15.019035 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:15.025152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.025643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.026079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.026778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.027228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.027649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.115450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: POST /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/os-volume_attachments HTTP/1.1 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 74 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:44:15.117402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {"volumeAttachment": {"volumeId": "1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a"}} Sep 26 01:44:15.119167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'server_id': '9d2665e6-6873-4c15-8efc-65665e9a6a5a', 'body': {'volumeAttachment': {'volumeId': '1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a'}}} Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:15.123502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:15.125206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 400 to user: Invalid volume: volume 1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a is already attached to instances: 3064a59e-2e5b-4254-bf1d-c76b549b31c6 {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-28d78b7f-aa39-42f8-b3f6-cebce8e47c26 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106507 Sep 26 01:44:15.127353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 494/983] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:44:15 2022] POST /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:44:15.130549 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:15.131241 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:15.131464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:15.132152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:15.139233 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.139464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.139756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.139996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.140184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.140722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.140911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.141359 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.141641 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.141779 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.142402 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.142905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.171992 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:44:15.278360 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-1b226d9a-8b95-4f8a-8b24-e9a63f155867 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 204 len: 0 microversion: 2.1 time: 0.151465 Sep 26 01:44:15.279533 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 495/984] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:44:15 2022] DELETE /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:44:15.288660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:15.289679 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:15.298553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.299248 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.299832 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.300723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.301326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.301890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.314765 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:15.322817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06b0d2f5-725d-4136-b03a-de3a9274458f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.198766 Sep 26 01:44:15.323832 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 490/985] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:15 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:15.359805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:15.360440 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:15.366701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.367198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.367633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.368337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:15.369001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:15.369765 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:15.552486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:15.562516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:15.564042 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7b439763-82c5-41e3-99e7-74513c184c21 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.279077 Sep 26 01:44:15.565243 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 496/986] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:15 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:15.571531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d457e9c-b99a-4201-9847-7f45d785853e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.216312 Sep 26 01:44:15.572239 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 491/987] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:15 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:16.347006 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:16.347698 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:16.354432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.354928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.357561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.358408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.358887 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.359299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.362229 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:16.527329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:16.536860 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-47490f9f-2271-48b7-aeec-32c97802b31b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.193653 Sep 26 01:44:16.548718 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 497/988] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:16 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:16.588928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:16.590614 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:16.595566 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:16.596326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:16.598619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.599280 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.599838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.601077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.601607 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.602133 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.603795 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.604622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.605271 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.606260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:16.606766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:16.607642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:16.845122 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:16.849895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:16.854588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-251f09d2-9aef-4fa9-9aca-9c382affe79e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.263317 Sep 26 01:44:16.855528 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 498/989] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:16 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:16.860211 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccac32c0-4b29-46a0-b08b-a86e7fe243fd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.275589 Sep 26 01:44:16.861908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 492/990] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:16 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:17.561620 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:17.562292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:17.570183 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.576179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.576664 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:17.577513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.577981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.578410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:17.802955 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:17.816012 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f170f3cf-0587-4237-9303-6acc1a6c8808 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.259087 Sep 26 01:44:17.831551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 499/991] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:17 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:17.878981 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:17.884568 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:17.885457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:17.886293 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:17.892050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.892563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.893001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:17.893702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.894155 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.894582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:17.894840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.895561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.896212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:17.897431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:17.898101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:17.898754 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.204367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:18.216617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-98e8e703-1326-4c99-9aa7-3334287af04d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.333768 Sep 26 01:44:18.216617 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 500/992] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:17 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:18.290000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:18.299711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa4bec2e-f40e-4b49-bf16-3cc63e2afb45 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.424749 Sep 26 01:44:18.300505 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 493/993] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:17 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:18.615244 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:18.621247 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891098ae-6262-467f-814b-d930d1540931", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:18.622009 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:18.641625 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.646045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:18.647586 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.649581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.650294 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.651247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.651905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.652639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.653276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.654233 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.671891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] Creating event network-changed:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:44:18.684500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-75f12e77-3dc5-4eee-a07b-68a4e2fc26e3 req-0a9aa607-e501-4c6d-b22b-358f1c5cf237 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066828 Sep 26 01:44:18.686840 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 494/994] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:18.699878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:44:18.816600 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6c93ef8f-99cc-45de-9f8a-f26db5709fc2 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 204 len: 0 microversion: 2.1 time: 0.203653 Sep 26 01:44:18.817491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 501/995] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:44:18 2022] DELETE /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:44:18.827921 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:18.828656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:18.836677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.837169 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.837605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.838538 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.839217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.839803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.843312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:18.844247 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:18.855169 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.856005 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.857390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:18.862254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:18.862254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:18.862254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:19.046312 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:19.074455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:19.084814 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-690e2c47-c705-43b4-b839-641f595e2a1a tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.261070 Sep 26 01:44:19.086787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 495/996] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:18 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:19.088531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:19.097105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2ce0fc9c-6506-4a12-bfbb-54024aa81976 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.261326 Sep 26 01:44:19.098001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 502/997] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:18 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:19.240224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:19.241029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:19.247019 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:19.248433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:19.248874 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:19.249567 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:19.250021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:19.250442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:19.326292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:19.326937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:19.333367 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:19.333870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:19.334309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:19.335016 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:19.335475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:19.335905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:19.404527 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=8 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:19.415822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:19.425777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45316fe0-4066-40eb-936f-e512819e0b4f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.189342 Sep 26 01:44:19.426491 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 496/998] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:19 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:19.491561 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:19.500210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-faa11e83-bf7c-4850-a0a9-a7b2d4b8acdd tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.178508 Sep 26 01:44:19.500810 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 503/999] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:19 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:20.108846 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:20.109467 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:20.116146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.116679 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.117116 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.117817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.118268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.118688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.119524 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:20.120329 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:20.127648 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.128147 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.128615 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.129342 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.129797 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.130218 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.395659 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:20.398080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:20.400207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:20.406658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7efb0ad5-74e4-4798-a76c-5d5c8fbe0e21 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.302176 Sep 26 01:44:20.407234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 497/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:20 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:20.408669 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8363a2a7-9ee6-48de-8edf-b1a4ae31fcea tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.293363 Sep 26 01:44:20.409241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 504/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:20 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:20.449883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:20.450543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:20.456702 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.457196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.457633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.458324 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.458778 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.459204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.523065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:20.523671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:20.530311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.530802 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.531236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.531934 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.532435 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.532863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.621356 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:20.629257 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9010e413-8381-4065-9b3f-a9641bd20e12 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.183145 Sep 26 01:44:20.629827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 498/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:20 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:20.684738 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:20.692957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d93a7465-70a4-4dcb-b048-eecfbc07178e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.173796 Sep 26 01:44:20.693522 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 505/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:20 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:20.701037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:20.710458 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:20.710925 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:20.711346 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:20.724337 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] Creating event network-changed:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:44:20.729122 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8c891e72-4fef-464c-86e7-3d1d627b2dd8 req-6aa6e8ef-5786-4434-978b-a1c023c68671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Sep 26 01:44:20.729685 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 499/1004] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:21.429864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:21.430473 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:21.432584 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:21.433283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:21.437649 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.438387 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.438820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.439518 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.439971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.440083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.440419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.440565 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.441003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.441695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.442148 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.442573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.639124 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:21.645728 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:21.646921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ea99ab00-e1b9-4882-a5b2-cde67283c003 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.221110 Sep 26 01:44:21.647501 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 506/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:21 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:21.652262 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:21.652899 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:21.654029 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1c305c0-12c6-48d4-87f3-3f91b14688bb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.226049 Sep 26 01:44:21.660834 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 500/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:21 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:21.661001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.661001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.661001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.661001 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.661340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.661340 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.716446 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:21.717061 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:21.723007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.723499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.723963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:21.724688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:21.725146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:21.729048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:22.076973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:22.084732 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-141c4ae3-0601-4b56-9d7f-3ab218b2b2c7 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.435959 Sep 26 01:44:22.085304 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 507/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:21 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:22.194848 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:22.203616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2ff0ee6-e67d-4ff4-8fd3-b187a281fedb tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.491123 Sep 26 01:44:22.204111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 501/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:21 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:22.671028 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:22.671540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:22.677530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:22.678276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:22.678415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:22.678773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:22.679213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:22.679929 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:22.680391 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:22.680826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:22.685307 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:22.686215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:22.686653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:22.687352 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:22.688052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:22.688764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:22.878928 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:22.894167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fac2463e-2c1d-45ad-91bb-ea7df44330ff tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1568 microversion: 2.1 time: 0.227623 Sep 26 01:44:22.905619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:22.912227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 508/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:22 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:22.921321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7684c41d-fa48-4b45-b7e7-ef5906b9fc11 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.247730 Sep 26 01:44:22.924165 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 502/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:22 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:23.108759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:23.109542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:23.115423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.115914 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.116376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.117078 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.117539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.117972 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.225902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:23.226524 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:23.234050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.234555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.235001 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.235714 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.237013 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.237486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.260388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:23.269153 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a355e971-dd4f-4248-bb8b-eb88de1689cb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1680 microversion: 2.1 time: 0.164907 Sep 26 01:44:23.269905 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 509/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:23 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:23.381175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:23.389455 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01208a1e-cc5c-493c-b42f-aaaa8fedcfbc tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1267 microversion: 2.1 time: 0.167428 Sep 26 01:44:23.390036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 503/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:23 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:23.920594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:23.921217 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:23.927724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.928207 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.928682 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.929377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.929861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.930285 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.946217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:23.947536 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:23.955648 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.956865 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.957501 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:23.958377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:23.959000 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:23.960619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.007279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:24.018636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fc153724-be27-41ab-b03e-a4fadd2613d3 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1501 microversion: 2.1 time: 0.102940 Sep 26 01:44:24.019375 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 510/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:23 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1501 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:24.083175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891098ae-6262-467f-814b-d930d1540931", "name": "network-vif-deleted", "tag": "63087146-5dff-4cf6-a44b-2902e0428945"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:24.095416 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.096254 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.096825 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.108397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] Creating event network-vif-deleted:63087146-5dff-4cf6-a44b-2902e0428945 for instance 891098ae-6262-467f-814b-d930d1540931 on hv-cinder-85920 Sep 26 01:44:24.113446 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-2ad51024-9b1f-4e3a-a4b9-95e0643bbd3d req-55518be7-3322-4bd0-ac69-848e0386636d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Sep 26 01:44:24.114322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 511/1014] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:24.130010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:24.138780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fb01689-b31a-47fa-9883-0553442f4d6a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.196598 Sep 26 01:44:24.160368 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 504/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:23 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:24.295100 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:24.295898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:24.307448 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.307939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.308395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.313155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.313630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.314058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.385643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:24.388660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:24.395715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-976a66ab-6d42-483c-96ff-fd8d0511a887 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1612 microversion: 2.1 time: 0.106705 Sep 26 01:44:24.396299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 512/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:24 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:24.413077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:24.413982 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:24.423898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.424403 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.425157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.426021 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.426479 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.426902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.691573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:24.703062 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-867842c7-7a8c-4f86-9c74-475dc33082a9 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1455 microversion: 2.1 time: 0.293256 Sep 26 01:44:24.705781 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 505/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:24 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1455 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:24.732520 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:24.733439 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:24.745836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.746631 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.748728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:24.749660 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:24.754014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:24.754014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.011349 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:25.020029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-59ee5b16-2aab-4631-8e20-42ad1bf0c71f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1455 microversion: 2.1 time: 0.291965 Sep 26 01:44:25.020953 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 513/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:24 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1455 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:25.043571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:25.044254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:25.051976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.052378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.052817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.053519 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.053968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.054534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.087979 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.088503 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.088943 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.089384 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lazy-loading 'fault' on Instance uuid 891098ae-6262-467f-814b-d930d1540931 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:25.136398 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:25.147630 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29f68ddb-fd10-4b02-96b6-75be1401841c tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1225 microversion: 2.1 time: 0.109280 Sep 26 01:44:25.148226 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 506/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:25 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:25.171741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:25.172014 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:25.174923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:25.178704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.179208 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.179642 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.180388 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.180840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.181266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.335044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:25.343686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e55adf05-8d9d-497f-8753-929d6e10f6e2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.176302 Sep 26 01:44:25.356829 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 514/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:25 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:25.420715 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:25.421777 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:25.430160 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.430944 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.431602 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.432588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.433132 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.433626 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.467934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:25.468450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:25.468891 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:25.469339 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'fault' on Instance uuid 9d2665e6-6873-4c15-8efc-65665e9a6a5a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:25.511963 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:25.521451 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-048a868e-be53-4d9b-9e52-01967cb7ea8b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1331 microversion: 2.1 time: 0.105740 Sep 26 01:44:25.521955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 507/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:25 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:26.143142 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2665e6-6873-4c15-8efc-65665e9a6a5a", "name": "network-vif-deleted", "tag": "ff646199-ff50-466a-aaa1-0699748e2a21"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:26.172606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.173087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.174005 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:26.175262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:26.176065 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.192322 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.192868 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.193312 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.194040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.194497 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.194928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.196307 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] Creating event network-vif-deleted:ff646199-ff50-466a-aaa1-0699748e2a21 for instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a on hv-cinder-85920 Sep 26 01:44:26.202513 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-df291c34-1d20-42ca-9baa-0f729e68206e req-f758940e-85c8-449e-b266-5123d72fda80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064548 Sep 26 01:44:26.215492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 515/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:26.262101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.263300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.264035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.264970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lazy-loading 'fault' on Instance uuid 891098ae-6262-467f-814b-d930d1540931 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:26.324775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c72b19a91804de398c476c5e1c404cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1d406b57f894053834ce17fa63fa6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:26.333769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7bfb535e-8ecb-418e-ac60-7981c7f59aa0 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 200 len: 1179 microversion: 2.1 time: 0.165981 Sep 26 01:44:26.334367 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 508/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:26 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 1179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:26.369084 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:26.370036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:26.376135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.376664 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.377107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.377804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.378263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.378691 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.514213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:26.524942 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d770a3b7-e3ed-4f92-9d43-1cd30d83ff64 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.159418 Sep 26 01:44:26.544821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 516/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:26 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:26.547198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:26.548469 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:26.556784 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.557473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.558174 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.559153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.560578 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.561175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.598164 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:26.598754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:26.599308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:26.600103 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'fault' on Instance uuid 9d2665e6-6873-4c15-8efc-65665e9a6a5a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:26.642388 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:26.651212 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dcf50713-67cf-4791-91d4-d4eda503278c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 200 len: 1331 microversion: 2.1 time: 0.108899 Sep 26 01:44:26.651907 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 509/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:26 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:27.358228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:27.358892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] [instance: 891098ae-6262-467f-814b-d930d1540931] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:27.365041 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.365517 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.365944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.366632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.367078 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.367503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.381097 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] HTTP exception thrown: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Request method failure captured: Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 HTTP/1.1 Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQKL7JnFn_yc7mdUYaOI-jgoCNOV5-XZxmWGgdK7GlBYKPlD_hEx1mtXBfYNRocryt8ufu79Xras5KGtPEyXEu9494ASpXl5MYGUlWg1ktWr5iWLOK88BLh9n3m9WuNmju_BsIdm4-sXruvzl_GUxU6Qu3T4-rLT42RYGGEDOxHrBcw Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: d1d406b57f894053834ce17fa63fa6ac Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-TestShelveInstance-400598511 Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:44:27.382767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d1d406b57f894053834ce17fa63fa6ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d1d406b57f894053834ce17fa63fa6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d1d406b57f894053834ce17fa63fa6ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d1d406b57f894053834ce17fa63fa6ac", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-TestShelveInstance-400598511 Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: d1d406b57f894053834ce17fa63fa6ac Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-TestShelveInstance-400598511 Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-TestShelveInstance-400598511-project Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 5c72b19a91804de398c476c5e1c404cf Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-TestShelveInstance-400598511-project Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. Sep 26 01:44:27.384462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '891098ae-6262-467f-814b-d930d1540931'} Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:44:27.385413 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. Sep 26 01:44:27.386921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.388694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Returning 404 to user: Instance 891098ae-6262-467f-814b-d930d1540931 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:44:27.388694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b5638cac-1a94-42b3-9beb-c68c41607012 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931" status: 404 len: 111 microversion: 2.1 time: 0.030642 Sep 26 01:44:27.388694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 517/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:27 2022] GET /compute/v2.1/servers/891098ae-6262-467f-814b-d930d1540931 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:44:27.552194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:27.553093 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:27.560880 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.561447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.562012 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.563284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.563805 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.564300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.566489 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-556780f2-9fed-49fa-a6b9-989b80c585f5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] Calling method '.version_select at 0x7f29d3837550>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:27.599971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-556780f2-9fed-49fa-a6b9-989b80c585f5 tempest-TestShelveInstance-400598511 tempest-TestShelveInstance-400598511-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1697878717" status: 202 len: 0 microversion: 2.1 time: 0.051681 Sep 26 01:44:27.600605 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 518/1027] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Sep 26 01:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1697878717 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:44:27.675228 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:27.676087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:27.683462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.683981 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.684658 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.685866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:27.686491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:27.688998 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:27.706756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a HTTP/1.1 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:44:27.708645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:44:27.710337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '9d2665e6-6873-4c15-8efc-65665e9a6a5a'} Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:44:27.711306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:44:27.713165 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:27.716891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:44:27.716891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-435172ae-3051-48f1-9638-b9250bf7412b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 404 len: 111 microversion: 2.1 time: 0.043643 Sep 26 01:44:27.716891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 519/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:27 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 01:44:27.725753 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bf64db55-243c-4750-bbf5-1dda140e8d04 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '.version_select at 0x7f29d37d1d30>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:27.737958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:27.746042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1e361f5-3b40-4109-a9ce-2ed9ddd52f48 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.198305 Sep 26 01:44:27.748390 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 510/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:27 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:27.765206 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bf64db55-243c-4750-bbf5-1dda140e8d04 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698508038" status: 202 len: 0 microversion: 2.1 time: 0.043216 Sep 26 01:44:27.765808 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 520/1030] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Sep 26 01:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698508038 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:44:28.226782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad4ef30-98fb-408a-8a13-e78e64481234", "tag": "8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:28.239313 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.239806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.240229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.253106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] Creating event network-changed:8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8 for instance 2ad4ef30-98fb-408a-8a13-e78e64481234 on hv-cinder-85920 Sep 26 01:44:28.257955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-556e5f6a-b2d1-4651-b0db-220bd260c83e req-e10a67b6-dce2-4931-aa28-7e16cf161fd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034851 Sep 26 01:44:28.258540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 511/1031] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:28.625306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:28.625900 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:28.633724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.634205 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.634635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.635336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.635766 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.636190 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.718414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'services' on Instance uuid 3064a59e-2e5b-4254-bf1d-c76b549b31c6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:28.773284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:28.774928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:28.784601 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.784983 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.785674 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.786483 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.786964 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.787531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.817111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b9128bdc-a062-47fa-912e-973f9d0623ef tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments/1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a" status: 202 len: 0 microversion: 2.1 time: 0.196242 Sep 26 01:44:28.826412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 521/1032] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:44:28 2022] DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments/1a237830-3bec-4f63-b7a1-a9a0e9a5ad1a => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:44:28.844870 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:28.850661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:28.859043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.859991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.860630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.861800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:28.862450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:28.863037 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:28.898852 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e232daef-b5b6-42f2-94f1-087e5ca06e2e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070150 Sep 26 01:44:28.899432 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 522/1033] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:44:28 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:29.192309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:29.200464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b49bb65-5c18-426c-ade8-c79fd610860f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.433491 Sep 26 01:44:29.201344 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 512/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:28 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:29.911576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:29.913750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:29.919912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:29.920438 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:29.920882 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:29.921587 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:29.922044 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:29.922468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:29.953738 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f161fcb2-cd66-4ddb-b16a-4a52430d6d95 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046278 Sep 26 01:44:29.954297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 523/1035] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:44:29 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:44:30.017411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:30.017903 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:30.020309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:30.025654 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.026146 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.026590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.027291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.027797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.028231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.055547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:44:30.079430 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:30.146224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35b08f3c-a493-4339-818a-7ec94a939fb6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 204 len: 0 microversion: 2.1 time: 0.132339 Sep 26 01:44:30.148229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 513/1036] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:44:30 2022] DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:44:30.157705 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:30.158326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:30.164492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.165131 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.165578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.166279 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.166745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.167174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.224484 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:30.225360 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:30.233508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.234158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.234696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.235532 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.236086 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.236635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:30.390425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:30.401633 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-dbab7002-4e5c-442e-af0b-8b69e1133e6c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1679 microversion: 2.1 time: 0.248964 Sep 26 01:44:30.403256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 524/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:30 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:30.423010 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:30.431064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d83e8b2-96b0-4b7e-8e48-e35f2400c9c8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.211507 Sep 26 01:44:30.431664 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 514/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:30 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:30.979435 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "name": "network-vif-plugged", "status": "completed", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:30.989565 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:30.990047 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:30.990498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:31.003390 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] Creating event network-vif-plugged:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:44:31.008373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-88edd09f-5b99-4378-a6c0-5b3fc66080c5 req-ed004ec5-69b9-4e40-a188-88f69645385e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Sep 26 01:44:31.008970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 525/1039] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:31.430227 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:31.431378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:31.439600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:31.440079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:31.440535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:31.441405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:31.442016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:31.442594 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:31.456584 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:31.457537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:31.464457 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:31.466155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:31.466880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:31.467819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:31.468479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:31.469786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:31.829187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:31.836949 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5fc92a68-ec48-4983-b66e-5f45b3e8e201 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.384728 Sep 26 01:44:31.837786 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 526/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:31 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:31.877598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:31.886267 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2826cefc-0ad1-4a21-961d-15fd46c5c140 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1679 microversion: 2.1 time: 0.461461 Sep 26 01:44:31.886856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 515/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:31 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:32.704847 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3064a59e-2e5b-4254-bf1d-c76b549b31c6", "name": "network-vif-deleted", "tag": "27ddfb03-d280-4cbc-98a9-c970a48fbd87"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:32.716966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.725178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.726196 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.745989 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] Creating event network-vif-deleted:27ddfb03-d280-4cbc-98a9-c970a48fbd87 for instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 on hv-cinder-85920 Sep 26 01:44:32.778043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-9f4dbc99-1e73-4b4a-acb7-28b31b4769f1 req-1de444de-bd5f-4e93-9829-e8e2da370db2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077397 Sep 26 01:44:32.778345 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 527/1042] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:32.862787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:32.864189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:32.876177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.876727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.877432 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.878158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.878621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.879052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.910646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:32.911344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:32.919369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.920058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.920542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.921594 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.922063 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.922492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.965193 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:32.965927 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:32.966419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:32.967073 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'fault' on Instance uuid 3064a59e-2e5b-4254-bf1d-c76b549b31c6 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:44:33.073653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:33.083757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f276e174-60c0-43c9-b90e-040727eca8a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 200 len: 1330 microversion: 2.1 time: 0.177199 Sep 26 01:44:33.084569 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 528/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:32 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 1330 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:33.161710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:33.170348 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4f4cf6c-21a8-4723-b43e-378926985cc8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1358 microversion: 2.1 time: 0.312162 Sep 26 01:44:33.171016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 516/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:32 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:34.108945 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.109551 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:34.116486 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.116975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.117423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.118092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.118540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.118960 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.133055 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 HTTP/1.1 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:44:34.134726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:44:34.136447 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '3064a59e-2e5b-4254-bf1d-c76b549b31c6'} Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:44:34.138231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:44:34.139866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:44:34.141353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:44:34.141353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-cfcc5c0d-6202-4400-aecd-b550857c1ac8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 404 len: 111 microversion: 2.1 time: 0.031350 Sep 26 01:44:34.141353 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 529/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:34 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:44:34.147206 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcd60c13-040a-4571-8d3e-735465d7f388 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '.version_select at 0x7f29d36671f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.165822 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcd60c13-040a-4571-8d3e-735465d7f388 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443178607" status: 202 len: 0 microversion: 2.1 time: 0.022406 Sep 26 01:44:34.166395 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 517/1046] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Sep 26 01:44:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443178607 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:44:34.194265 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.195234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:34.201861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.202542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.203176 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.203876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.204325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.204787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.457363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:34.471337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-628c8d41-d045-4bdd-bdb4-36c16da260fa tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1546 microversion: 2.1 time: 0.279750 Sep 26 01:44:34.488240 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 530/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:34 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1546 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:34.495506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.496588 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:34.502933 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.503423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.504072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.505140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.505768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.507350 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.720024 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:34.727717 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bafabaa-392a-43b3-88d1-aaa9a4e5232f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1546 microversion: 2.1 time: 0.236086 Sep 26 01:44:34.728291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 518/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:34 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:34.750058 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.755404 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:34.756426 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Searching by: {'deleted': False, 'project_id': '63b4276ece354a06b400b45e9e49186b'} {{(pid=127126) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 01:44:34.763913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.764753 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.765396 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.766109 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.766726 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.767326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.865639 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.multi_cell_list [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127126) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 01:44:34.935490 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-044fb689-f720-4f94-b5bf-54f646284849 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: .version_select at 0x7f29d373d040>, body: {"keypair": {"name": "tempest-keypair-1545774572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2F2BHYxbyajwSwOKVhOsX6mdHv/HHn3ZkrXTrSKYtDTw21juD3kqJdp11DaTsv13wmdxErWhIWvESPgnuPyEWnaythHQJ7aui8a5MJBChTkvhNSbh59bo+pMx0Oximxg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:34.952526 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-044fb689-f720-4f94-b5bf-54f646284849 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:44:34.956561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-044fb689-f720-4f94-b5bf-54f646284849 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:44:34.977252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-25c10b7c-4296-4102-b588-227a35f098eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.231390 Sep 26 01:44:34.977829 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 531/1049] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Sep 26 01:44:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:34.984493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-044fb689-f720-4f94-b5bf-54f646284849 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049933 Sep 26 01:44:34.984493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 519/1050] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:44:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:34.990032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:34.990756 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:34.997701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:34.998283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:34.998797 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:34.999573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:35.000711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:35.000711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:35.233520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:35.242760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e7f77fc-d070-4348-9cfe-b43779c0363a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1546 microversion: 2.1 time: 0.256905 Sep 26 01:44:35.247325 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 520/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:34 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:36.578237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-467338052", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f9f02f3-760e-48dc-b09d-e8f3d058e4c5"}], "security_groups": [{"name": "tempest-securitygroup--215106643"}], "key_name": "tempest-keypair-1545774572", "user_data": "}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:36.715750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] validate_networks() for [('3f9f02f3-760e-48dc-b09d-e8f3d058e4c5', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:44:36.993131 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c7c2991-1c84-4293-baef-09b2ebc455fb"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:36.996915 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:37.005287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:37.005287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:37.005287 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:37.005932 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:37.006375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:37.006800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:37.243263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:44:37.243693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:44:37.244167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:44:37.244603 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:44:37.245025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:44:37.256268 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:37.257408 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:37.258595 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:37.260172 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:37.261516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:37.262863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:37.288494 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:44:37.294171 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:44:37.309984 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:44:37.313542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:44:37.342336 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c472356-fb35-4232-aff5-4883ca0889eb tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352874 Sep 26 01:44:37.343282 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 521/1052] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:44:36 2022] POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:37.385343 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5d82fb31-3c90-4537-bca5-fb64875c67b4 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.812456 Sep 26 01:44:37.386553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 532/1053] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:44:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:44:37.403833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de8910b8-d1fe-4b05-9f6a-914120724680 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:37.405816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de8910b8-d1fe-4b05-9f6a-914120724680 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:37.526111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-de8910b8-d1fe-4b05-9f6a-914120724680 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:37.537066 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de8910b8-d1fe-4b05-9f6a-914120724680 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1241 microversion: 2.1 time: 0.140768 Sep 26 01:44:37.540425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 522/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:37 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:38.565886 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:38.566492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:38.573257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:38.573757 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:38.574292 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:38.575275 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:38.575728 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:38.576152 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:38.649310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:38.658781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e7c6f76a-9e1e-431e-b3a8-bab94034113c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1293 microversion: 2.1 time: 0.097450 Sep 26 01:44:38.659373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 533/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:38 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:44:39.682283 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:39.683002 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:39.691192 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:39.691688 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:39.692131 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:39.692889 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:39.693347 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:39.693780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:39.825214 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:39.833720 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c235f53c-0c15-4a18-9da7-72cd3e4298c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.155295 Sep 26 01:44:39.834293 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 523/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:39 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:40.063085 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b264a55d-6093-4e76-b67b-79197f8e4dbf", "tag": "ba0525e0-346f-4352-a361-9e7d00e687ed"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:40.073577 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:40.074210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:40.074643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:40.085723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] Creating event network-changed:ba0525e0-346f-4352-a361-9e7d00e687ed for instance b264a55d-6093-4e76-b67b-79197f8e4dbf on hv-cinder-85920 Sep 26 01:44:40.091029 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-a035931f-b24e-4dbb-8b97-48978b0b890a req-e227518d-b040-4829-86b8-37dfe0988218 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Sep 26 01:44:40.091752 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 534/1057] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:40.856499 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:40.857136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:40.863564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:40.864043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:40.864512 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:40.865200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:40.865656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:40.866081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:40.992596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:41.000861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8c7b6aa-2af3-4599-b70e-c4719657a85e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.148242 Sep 26 01:44:41.001424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 524/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:40 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:42.026592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:42.028002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:42.034164 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:42.034643 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:42.035079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:42.035767 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:42.036222 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:42.036670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:42.051665 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:42.178896 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:42.187921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0aac10ee-7b69-413d-8680-da347fd7b029 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.165740 Sep 26 01:44:42.188538 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 535/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:42 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:43.210985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:43.211599 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:43.218136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:43.218616 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:43.219052 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:43.219748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:43.220198 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:43.220653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:43.368923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:43.381115 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-363c0194-9260-470e-a876-977ece4a93fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.170492 Sep 26 01:44:43.381766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 525/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:43 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:43.940024 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:43.940670 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:43.946924 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:43.947405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:43.947839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:43.948559 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:43.949645 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:43.950234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:44.081215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:44.089212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3056c782-7eb4-47ed-b656-6f4d4e2ae575 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1592 microversion: 2.1 time: 0.153256 Sep 26 01:44:44.089976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 536/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:43 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1592 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:44.403611 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:44.404442 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:44.410923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:44.411504 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:44.412008 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:44.412802 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:44.413323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:44.413823 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:44.631601 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:44.640150 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4ad6cf9-5c9a-4e09-a27f-16e145123266 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.241027 Sep 26 01:44:44.640748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 526/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:44 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:44.983428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b264a55d-6093-4e76-b67b-79197f8e4dbf", "name": "network-vif-plugged", "status": "completed", "tag": "ba0525e0-346f-4352-a361-9e7d00e687ed"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:44.994314 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:44.994937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:44.995711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:45.008627 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] Creating event network-vif-plugged:ba0525e0-346f-4352-a361-9e7d00e687ed for instance b264a55d-6093-4e76-b67b-79197f8e4dbf on hv-cinder-85920 Sep 26 01:44:45.014655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-b1f72f86-87a0-4964-aecf-fcbf5835c3e2 req-dba4c0c7-0c98-4a17-ab1e-31ac07575a54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Sep 26 01:44:45.015259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 537/1063] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:45.664439 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:45.665046 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:45.672592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:45.673083 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:45.673520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:45.674234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:45.674686 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:45.675106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:46.037107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:46.046152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07c97505-9124-40dc-8db2-6d33c7fa5620 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1366 microversion: 2.1 time: 0.385671 Sep 26 01:44:46.047007 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 527/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:45 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:46.321070 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:46.332261 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:46.332932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:46.333371 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:46.347145 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] Creating event network-changed:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:44:46.352092 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-e1f14abc-74f6-4de2-ba55-058a808595f7 req-54758caa-3b36-46c8-a4bd-24109e61f328 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035197 Sep 26 01:44:46.352756 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 538/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:47.069518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:47.070298 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:47.077931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.078426 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.078850 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.080266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.080266 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.080622 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.317065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:47.331036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-51651722-4bfd-44ae-9b4a-d72a998a76e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1555 microversion: 2.1 time: 0.265241 Sep 26 01:44:47.342522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 528/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:47 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:47.354683 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=4 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:47.355990 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:47.361412 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:47.362159 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:47.368751 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.369234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.369661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.370898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.371549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.372337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.491215 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-480611430"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:47.491761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:47.499792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.500709 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.501376 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.502610 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:47.503535 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:47.504316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:47.505692 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-200bdf79-7133-4959-af3f-63e84ff2a61d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152210 Sep 26 01:44:47.514233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 539/1067] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:44:47 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:44:47.536785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:44:47.794578 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Adding security group 939c25d0-825e-46df-a195-fff9d96e48fe to port 3ca478bf-2db2-409b-939f-46e8d2591a1d Sep 26 01:44:48.477487 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4c629dc-c88c-4437-8677-6335108b4d9a tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action" status: 202 len: 0 microversion: 2.1 time: 0.990189 Sep 26 01:44:48.479188 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 529/1068] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:44:47 2022] POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:44:48.487278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:48.496545 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:44:48.497157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:44:48.507578 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:48.508068 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:48.508531 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:48.510773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:48.511855 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:48.512278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:48.513883 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:48.514343 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:48.514962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:48.543980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] Creating event network-changed:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:44:48.551694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-df72a373-3f8b-40a6-94f7-389dd4e42042 req-ad962b3d-4ede-46ef-a725-676fddeaf42d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068807 Sep 26 01:44:48.553155 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 540/1069] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:44:48.769704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:44:48.784296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03c8e192-a63f-4d84-8d0a-da68bfe15845 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1756 microversion: 2.1 time: 0.298212 Sep 26 01:44:48.800217 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 530/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:44:48 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1756 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:44:50.569792 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b264a55d-6093-4e76-b67b-79197f8e4dbf", "tag": "ba0525e0-346f-4352-a361-9e7d00e687ed"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:44:50.579641 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:44:50.580111 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:44:50.580567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:44:50.591417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] Creating event network-changed:ba0525e0-346f-4352-a361-9e7d00e687ed for instance b264a55d-6093-4e76-b67b-79197f8e4dbf on hv-cinder-85920 Sep 26 01:44:50.596252 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-4ad8b163-6601-4476-8cea-6894a9755e9a req-c8a85b66-6499-4699-8cec-db14d7a64955 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030358 Sep 26 01:44:50.596950 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 541/1071] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:11.490576 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:11.492955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:11.495719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:11.496489 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:11.502309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:11.502789 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:11.503220 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:11.503908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:11.504379 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:11.504806 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:11.578706 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-596e5ddc-cd1a-4c3f-ac3d-2a6b96938566 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action" status: 202 len: 0 microversion: 2.1 time: 0.091877 Sep 26 01:45:11.579332 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 531/1072] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:45:11 2022] POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:45:11.585278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:11.586079 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=21 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:11.591306 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:11.592010 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:11.599563 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:11.600067 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:11.600674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:11.601315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:11.601761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:11.602184 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:11.753734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:11.762465 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5d2d4957-9310-4547-ad83-28c033347775 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1748 microversion: 2.1 time: 0.178805 Sep 26 01:45:11.763232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 542/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:11 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1748 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:12.788223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:12.788961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:12.795138 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:12.795618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:12.796053 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:12.796769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:12.797315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:12.797776 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:12.947331 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:12.956254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7466b2c-2cff-4daa-9c77-2f41ab3d81d6 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.172785 Sep 26 01:45:12.956851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 532/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:12 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:13.978952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:13.979567 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:13.986674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:13.987168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:13.987616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:13.988308 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:13.988787 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:13.989249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:14.133025 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:14.141999 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-52636ab1-8c49-44fb-b1bc-5226c3fc7e96 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.166639 Sep 26 01:45:14.142661 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 543/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:13 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:45:15.167675 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:15.168419 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:15.174934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:15.175411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:15.175836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:15.176543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:15.176986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:15.177401 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:15.322333 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:15.331035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-148ae5e9-ae4e-49e5-9bc5-014845221539 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.167185 Sep 26 01:45:15.331590 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 533/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:15 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:16.354571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:16.355105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:16.361622 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:16.362107 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:16.362542 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:16.363234 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:16.363687 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:16.364110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:16.509475 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:16.517719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a3eb4217-05f9-4a29-97d0-1e605e2e961f tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.167085 Sep 26 01:45:16.518285 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 544/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:16 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:17.541819 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:17.542425 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:17.549065 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:17.549545 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:17.549976 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:17.550653 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:17.551099 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:17.551514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:17.691551 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:17.699695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ae2e53f-1a88-48c3-9178-dc14b59ba22b tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.162082 Sep 26 01:45:17.700259 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 534/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:17 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:18.723167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:18.723781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:18.730502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:18.730982 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:18.731410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:18.732123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:18.732607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:18.733026 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:18.879980 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:18.888150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ede3f02d-7113-4028-841a-863c3a518ee2 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.168970 Sep 26 01:45:18.888749 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 545/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:18 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:19.911997 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:19.912573 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:19.918790 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:19.919265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:19.919692 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:19.920392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:19.920841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:19.921263 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:20.065571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:20.073697 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c812a589-0f1d-403e-a000-5163154544c9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.165835 Sep 26 01:45:20.074254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 535/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:19 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:21.098260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:21.098873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:21.105499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:21.105982 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:21.106417 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:21.107103 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:21.107554 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:21.107975 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:21.255231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:21.263283 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-88c50212-7d98-494e-b55c-875664767940 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.169514 Sep 26 01:45:21.263841 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 546/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:21 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:22.286852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:22.287465 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:22.294042 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:22.294522 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:22.294958 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:22.295645 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:22.296098 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:22.296561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:22.440182 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:22.448360 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64353b26-49f3-42cb-b9a3-c7a0b2ab078e tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1753 microversion: 2.1 time: 0.165411 Sep 26 01:45:22.448931 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 536/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:22 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:45:23.528940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:23.529546 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:23.536232 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:23.536745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:23.537175 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:23.537861 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:23.538311 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:23.538735 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:23.681585 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:23.690592 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-120abb36-8c43-4d07-8b57-ea666e7306be tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1756 microversion: 2.1 time: 0.168600 Sep 26 01:45:23.691130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 547/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:23 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:26.850672 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:26.851223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:26.857555 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:26.858037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:26.858473 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:26.859163 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:26.859633 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:26.860050 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:26.883318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4d9052a-73ed-46c0-8f00-6ae3c7f03617 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/ips" status: 200 len: 149 microversion: 2.1 time: 0.036604 Sep 26 01:45:26.883880 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 537/1084] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:45:26 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:28.217773 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd01565-f5d6-4497-8958-ee77016ec249"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:28.220775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:28.227363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:28.227840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:28.228273 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:28.228986 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:28.229433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:28.229862 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:28.463740 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5ae35c2e-1835-4242-ae60-5a9804dd7fe5 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249751 Sep 26 01:45:28.464394 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 548/1085] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:45:28 2022] POST /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:36.005800 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdd01565-f5d6-4497-8958-ee77016ec249"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:36.008179 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:36.014755 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.015367 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.015959 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.016695 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.017157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.017589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.095987 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments HTTP/1.1 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 74 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:45:36.097758 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {"volumeAttachment": {"volumeId": "cdd01565-f5d6-4497-8958-ee77016ec249"}} Sep 26 01:45:36.099471 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'server_id': 'b264a55d-6093-4e76-b67b-79197f8e4dbf', 'body': {'volumeAttachment': {'volumeId': 'cdd01565-f5d6-4497-8958-ee77016ec249'}}} Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:45:36.100687 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:36.102229 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 400 to user: Invalid volume: volume cdd01565-f5d6-4497-8958-ee77016ec249 is already attached to instances: b264a55d-6093-4e76-b67b-79197f8e4dbf {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c9437a9b-6c00-439b-b3e8-9991a154a0bb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097456 Sep 26 01:45:36.103913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 538/1086] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:45:36 2022] POST /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 01:45:36.166629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:36.167202 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:36.174233 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.174710 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.175138 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.175820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.176272 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.176720 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.256921 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'services' on Instance uuid b264a55d-6093-4e76-b67b-79197f8e4dbf {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:45:36.329666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-17e65ddb-1834-4eef-9136-1c6088a1c4fb tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments/cdd01565-f5d6-4497-8958-ee77016ec249" status: 202 len: 0 microversion: 2.1 time: 0.167723 Sep 26 01:45:36.330259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 549/1087] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:45:36 2022] DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments/cdd01565-f5d6-4497-8958-ee77016ec249 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:45:36.338456 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:36.340636 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:36.348335 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.348861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.349302 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.350009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:36.350466 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:36.350914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:36.380740 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b635113e-2143-481c-8b87-63c34ae04dc1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Sep 26 01:45:36.381294 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 539/1088] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:45:36 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:37.394578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:37.396940 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:37.403119 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.403608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.404043 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.404761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.405216 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.406190 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.435231 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-b724e3b8-210f-415b-b2bf-66a3a89c7f83 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045630 Sep 26 01:45:37.435790 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 550/1089] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:45:37 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:45:37.500417 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:37.500928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:37.507375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.507851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.508281 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.509842 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.510319 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.510759 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.538067 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:45:37.619956 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e9d678b7-5961-41ae-b97b-e2ead0f7cb50 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 204 len: 0 microversion: 2.1 time: 0.123725 Sep 26 01:45:37.620559 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 540/1090] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:45:37 2022] DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:45:37.629570 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:37.630174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:37.635938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.636469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.636889 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.637562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:37.638011 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:37.638425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:37.790613 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:37.798716 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-d81c5ddb-54ae-4a87-8c23-dbac8b483c8a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1680 microversion: 2.1 time: 0.173015 Sep 26 01:45:37.799473 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 551/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:37 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:38.831427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:38.832153 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:38.838552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:38.838986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:38.839423 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:38.840108 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:38.840603 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:38.841026 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:38.970711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:38.978345 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-359fa6c0-1bda-428a-a01d-b2c474eef3b6 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1680 microversion: 2.1 time: 0.151226 Sep 26 01:45:38.978894 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 541/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:38 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:40.002550 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:40.003212 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:40.010213 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:40.010696 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:40.011135 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:40.011821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:40.012270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:40.012719 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:40.084775 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:40.096745 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0f2302d3-c14d-4c01-8b0b-4aabae62122c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 200 len: 1613 microversion: 2.1 time: 0.097995 Sep 26 01:45:40.097433 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 552/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:39 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:40.147970 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b264a55d-6093-4e76-b67b-79197f8e4dbf", "name": "network-vif-deleted", "tag": "ba0525e0-346f-4352-a361-9e7d00e687ed"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:40.161130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:40.162132 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:40.162639 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:40.176896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] Creating event network-vif-deleted:ba0525e0-346f-4352-a361-9e7d00e687ed for instance b264a55d-6093-4e76-b67b-79197f8e4dbf on hv-cinder-85920 Sep 26 01:45:40.182644 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3efe35bd-0f43-4db2-883b-ef2e3681e1c1 req-42b6b6ec-484a-4131-9045-fe1c8ff80e53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037832 Sep 26 01:45:40.187540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 542/1094] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:41.120854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:41.121467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:41.128851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:41.129372 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:41.129801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:41.130531 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:41.131006 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:41.131421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:41.145751 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf HTTP/1.1 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:45:41.147385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:45:41.149110 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'b264a55d-6093-4e76-b67b-79197f8e4dbf'} Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:45:41.149970 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:45:41.151310 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:45:41.152511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:45:41.152511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0650b444-1766-4f45-a8c2-49210819799a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 404 len: 111 microversion: 2.1 time: 0.031838 Sep 26 01:45:41.152511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 553/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:41 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:45:41.159077 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3db92eba-4c6b-4404-a12f-32bc93f4f2c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '.version_select at 0x7f29d389fc10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:41.178580 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3db92eba-4c6b-4404-a12f-32bc93f4f2c9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545774572" status: 202 len: 0 microversion: 2.1 time: 0.024276 Sep 26 01:45:41.179131 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 543/1096] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Sep 26 01:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545774572 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:45:41.774174 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4c1f6983-ee90-4925-912f-44dae7310a94 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: .version_select at 0x7f29d3837b80>, body: {"keypair": {"name": "tempest-keypair-1618086432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuhE52bCFPIgVKlipfZn2G7IlBK4tHP/Lof9M2MN0mxHoUvPOdheo2BMa6fYkuSQnjge8hmMiWgsxofp6aY3kXrTRII4sopDPYCExlypRRt00KWRaQe6UJxZrn412jpMw=="}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:41.779474 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=25 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:41.791798 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-4c1f6983-ee90-4925-912f-44dae7310a94 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:45:41.795793 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-4c1f6983-ee90-4925-912f-44dae7310a94 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'key_pairs'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:45:41.818636 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4c1f6983-ee90-4925-912f-44dae7310a94 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048300 Sep 26 01:45:41.819230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 554/1097] 10.222.0.25 () {60 vars in 1159 bytes} [Mon Sep 26 01:45:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:43.308486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1091339443", "imageRef": "b145722e-d08d-41a4-b67f-e75c3b4a2c2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f9f02f3-760e-48dc-b09d-e8f3d058e4c5"}], "security_groups": [{"name": "tempest-securitygroup--1117820860"}], "key_name": "tempest-keypair-1618086432", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:43.318785 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:43.414412 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] validate_networks() for [('3f9f02f3-760e-48dc-b09d-e8f3d058e4c5', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:45:43.783520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:45:43.783941 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:45:43.784443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:45:43.784848 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:45:43.785252 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:45:43.794090 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:43.794571 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:43.795003 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:43.795734 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:43.796914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:43.797330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:43.804564 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:43.818045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:45:43.821996 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.quota [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Getting quotas for user 64c98c1da1a847389fa035d86f6326de and project 7e247930abd14072b8dfab4043d3e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:45:43.832916 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:45:43.835297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b145722e-d08d-41a4-b67f-e75c3b4a2c2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:45:43.882234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cea9470f-6028-464f-9c42-0fc7c45c3820 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578141 Sep 26 01:45:43.882893 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 544/1098] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:45:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:45:43.894425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-7413507e-8930-4855-aca4-68521cfa507d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:43.895146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-7413507e-8930-4855-aca4-68521cfa507d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:43.951114 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-7413507e-8930-4855-aca4-68521cfa507d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:43.958076 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-7413507e-8930-4855-aca4-68521cfa507d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1242 microversion: 2.1 time: 0.067791 Sep 26 01:45:43.958893 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 555/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:43 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:44.981589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:44.982844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:44.989424 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:44.989911 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:44.990543 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:44.991245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:44.991694 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:44.992299 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:45.081640 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:45.089464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b2f38fb2-b071-4a78-bfa4-66e221d8aca9 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1302 microversion: 2.1 time: 0.112139 Sep 26 01:45:45.090197 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 545/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:44 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:46.115215 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:46.115724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:46.121902 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:46.122477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:46.122800 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:46.123492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:46.124080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:46.124578 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:46.127266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:46.357780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f62aff-61a8-4ce7-af39-f5f588352f21", "tag": "f18080d2-eefc-4329-b872-de34c2711ea0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:46.370924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:46.371712 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:46.372308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:46.390961 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] Creating event network-changed:f18080d2-eefc-4329-b872-de34c2711ea0 for instance c6f62aff-61a8-4ce7-af39-f5f588352f21 on hv-cinder-85920 Sep 26 01:45:46.397743 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8ee83a33-48d0-4a05-8537-dab1754976f7 req-b0be2f98-e65d-449a-84c8-e9901c358b05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046102 Sep 26 01:45:46.398540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 546/1101] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:45:46.534774 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:46.542379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-88c2eed9-c08c-43d4-806d-4513725b09fc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.431261 Sep 26 01:45:46.543040 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 556/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:46 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:47.567234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:47.567920 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:47.574047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:47.574525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:47.574953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:47.575631 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:47.576076 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:47.576534 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:47.709530 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:47.717240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-957f77fc-14fb-4f83-875f-e2e2baae4bcd tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.155237 Sep 26 01:45:47.717838 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 547/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:47 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:48.740259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:48.740894 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:48.747276 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:48.747759 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:48.748195 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:48.749505 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:48.749956 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:48.750379 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:48.885428 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:48.893587 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-85ddadc5-d0af-4f7b-a4f9-a1a4a46cb7bc tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.157189 Sep 26 01:45:48.894150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 557/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:48 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:49.915895 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:49.916539 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:49.922986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:49.923470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:49.923905 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:49.924625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:49.925079 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:49.925502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:50.055405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:50.063292 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a90fc4c6-1774-492b-bae8-9484f421876a tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.151283 Sep 26 01:45:50.063859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 548/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:49 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:51.086809 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:51.087423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:51.094315 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:51.094796 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:51.095237 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:51.095938 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:51.096419 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:51.096851 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:51.228539 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:51.237258 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c7d56fde-8478-460f-ad2f-8e55d4ffe525 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.154423 Sep 26 01:45:51.237840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 558/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:51 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:51.244392 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f62aff-61a8-4ce7-af39-f5f588352f21", "name": "network-vif-plugged", "status": "completed", "tag": "f18080d2-eefc-4329-b872-de34c2711ea0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:51.255234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:51.255600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:51.256028 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:51.268189 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] Creating event network-vif-plugged:f18080d2-eefc-4329-b872-de34c2711ea0 for instance c6f62aff-61a8-4ce7-af39-f5f588352f21 on hv-cinder-85920 Sep 26 01:45:51.272965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5f6b8e9a-c17e-4fca-ae84-3e1be5375fc5 req-c7c25530-dc2d-49ef-8bf2-f30345cdc7d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Sep 26 01:45:51.273547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 549/1107] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:45:52.261289 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:52.261890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:52.268964 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:52.269442 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:52.269873 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:52.270556 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:52.271007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:52.271427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:52.399187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:52.407327 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-066c0abb-63e8-4952-b36d-f1ffca2d556b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1368 microversion: 2.1 time: 0.149908 Sep 26 01:45:52.407890 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 559/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:52 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:53.431525 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:53.432140 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:53.439290 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:53.439771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:53.440205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:53.441043 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:53.441495 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:53.441918 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:53.578734 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:45:53.586261 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b57f2f5-34f4-4e25-9095-cc41003b114d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1557 microversion: 2.1 time: 0.159490 Sep 26 01:45:53.586816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 550/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:45:53 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:45:53.609389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:45:53.609891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:53.616061 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:53.616581 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:53.617015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:53.617704 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:53.618154 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:53.618574 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:53.702007 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-53baa891-103d-4b16-9ba0-a7c88e98cd07 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096839 Sep 26 01:45:53.702736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 560/1110] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Sep 26 01:45:53 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:54.634180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f62aff-61a8-4ce7-af39-f5f588352f21", "tag": "f18080d2-eefc-4329-b872-de34c2711ea0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:54.639069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:54.640321 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:54.647381 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:54.647852 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:54.648300 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:54.659562 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] Creating event network-changed:f18080d2-eefc-4329-b872-de34c2711ea0 for instance c6f62aff-61a8-4ce7-af39-f5f588352f21 on hv-cinder-85920 Sep 26 01:45:54.664438 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-15ac066b-ac73-40d0-be22-241507bb387d req-8878d143-79b1-49ea-aa15-5ee754f293c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033862 Sep 26 01:45:54.665107 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 551/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:45:59.168646 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:45:59.173488 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-480611430"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:59.173985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:45:59.180423 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:59.180973 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:59.181467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:59.182161 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:59.182616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:59.183177 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:59.323761 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.network.security_group_api [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Removing security group 939c25d0-825e-46df-a195-fff9d96e48fe from port 3ca478bf-2db2-409b-939f-46e8d2591a1d Sep 26 01:45:59.651537 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-0e13e486-2d78-49b8-9b83-dce6aab81708 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action" status: 202 len: 0 microversion: 2.1 time: 0.483390 Sep 26 01:45:59.652576 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 561/1112] 10.222.0.25 () {60 vars in 1278 bytes} [Mon Sep 26 01:45:59 2022] POST /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:45:59.662780 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:45:59.689406 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:45:59.690144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:45:59.690768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:45:59.707365 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] Creating event network-changed:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:45:59.723754 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7096e652-ee3e-49a9-9d38-ecfe04066208 req-063a1313-8a2b-45b7-a5ae-8d594a0735ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065286 Sep 26 01:45:59.725492 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 552/1113] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:00.786336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:00.786840 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:00.792878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:00.793357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:00.793782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:00.794464 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:00.794939 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:00.795461 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:00.892511 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lazy-loading 'services' on Instance uuid 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:46:00.967241 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-bb196770-6dfe-43d8-bcb3-cb639be15bee tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments/0c7c2991-1c84-4293-baef-09b2ebc455fb" status: 202 len: 0 microversion: 2.1 time: 0.185058 Sep 26 01:46:00.968629 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 562/1114] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:46:00 2022] DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments/0c7c2991-1c84-4293-baef-09b2ebc455fb => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:46:00.978986 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:00.981270 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:00.987665 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:00.988130 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:00.988705 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:00.989318 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:00.989775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:00.990193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:01.022386 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-274d4fa7-09ec-4c98-8e2c-c95ab32c8de9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048103 Sep 26 01:46:01.022953 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 553/1115] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:46:00 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:01.741836 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:01.752188 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:01.752723 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:01.753163 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:01.764377 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] Creating event network-changed:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:46:01.769179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-3e90125a-6e22-459b-9199-d8bce36dc9f0 req-9ca7489f-1bfe-4fed-a521-adb2ad12b15d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Sep 26 01:46:01.769833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 563/1116] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:02.035492 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:02.038323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:02.048265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:02.048265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:02.048265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:02.048265 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:02.049427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:02.049427 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:02.081619 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d65aa9d3-20dc-438d-a37f-45d36d1b23db tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050096 Sep 26 01:46:02.082586 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 554/1117] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:46:02 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:03.010644 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-403150033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1126381645", "security_groups": [{"name": "tempest-secgroup-smoke-1718875407"}], "block_device_mapping_v2": [{"uuid": "d1932ae6-3fd0-4412-af45-9043f16e2097", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9880eab6-c89c-4490-9622-c91f1df8e6a8"}]}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:03.095112 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:03.097291 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:03.103969 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.104493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.104964 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.105671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.106129 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.106589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.128123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.network.neutron [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] validate_networks() for [('9880eab6-c89c-4490-9622-c91f1df8e6a8', None, None, None, None, None)] {{(pid=127126) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 01:46:03.136394 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1b256f8-6492-4bf9-9c6c-cdc6ee1a1eb8 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046328 Sep 26 01:46:03.136965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 555/1118] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:46:03 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 01:46:03.147128 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:03.147623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:03.153353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.153844 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.154792 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.155514 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.155955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.156408 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.370317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] HTTP exception thrown: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 is not attached to volume 0c7c2991-1c84-4293-baef-09b2ebc455fb Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Request method failure captured: Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments/0c7c2991-1c84-4293-baef-09b2ebc455fb HTTP/1.1 Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQPVmrdingHgbdo_8fBxgVV7BuuMP8w4UdGFvIFjVUmfKOJ-d_BLBsu1fZBsxjOeQ6cV7DL7GsbHZGBXCeJS8bTPFRQ725LWBBbx2oHATWIk3TAVMJfsYbJJioxfT3yLcMDMXAudSZzEQLRJXmeynSfpg34gxrjdObQKkMoNzu89X-Y Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 63b4276ece354a06b400b45e9e49186b Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:03.372696 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63b4276ece354a06b400b45e9e49186b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 63b4276ece354a06b400b45e9e49186b Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-1444211625-project Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: e1d3321cdb59406da03c91fd8ec71885 Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-1444211625-project Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:03.375177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 is not attached to volume 0c7c2991-1c84-4293-baef-09b2ebc455fb Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'server_id': '76e69c76-ef7a-4483-a6a0-f5ca65f98d22', 'id': '0c7c2991-1c84-4293-baef-09b2ebc455fb'} Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0c7c2991-1c84-4293-baef-09b2ebc455fb. Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:03.376045 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 is not attached to volume 0c7c2991-1c84-4293-baef-09b2ebc455fb Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 is not attached to volume 0c7c2991-1c84-4293-baef-09b2ebc455fb Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:03.377677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Returning 404 to user: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 is not attached to volume 0c7c2991-1c84-4293-baef-09b2ebc455fb {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:03.378764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-157f65fb-cdd7-4b62-980f-5517a13af5f9 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments/0c7c2991-1c84-4293-baef-09b2ebc455fb" status: 404 len: 154 microversion: 2.1 time: 0.231344 Sep 26 01:46:03.378764 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 556/1119] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:46:03 2022] DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22/os-volume_attachments/0c7c2991-1c84-4293-baef-09b2ebc455fb => generated 154 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 01:46:03.518580 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 01:46:03.519004 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image limits 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 01:46:03.519479 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Flavor pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 01:46:03.519913 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Image pref 0:0:0 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 01:46:03.520323 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.virt.hardware [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127126) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 01:46:03.528976 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.530056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.530491 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.531223 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:03.531678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:03.532105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:03.548376 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 01:46:03.552245 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.quota [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Getting quotas for user a47ec612bce54bc8b2062b03d36d10d4 and project 786ed33f027946f581147e672b947df0. Resources: {'instances', 'ram', 'cores'} {{(pid=127126) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 01:46:03.610529 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Going to run 1 instances... {{(pid=127126) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 01:46:03.612900 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1932ae6-3fd0-4412-af45-9043f16e2097',volume_size=None,volume_type=None)] {{(pid=127126) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 01:46:03.750459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8fb3e0c1-fb1b-4d35-8484-8292c0af4f54 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744420 Sep 26 01:46:03.751115 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 564/1120] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Sep 26 01:46:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 01:46:03.762106 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3a3f0a4-b5b4-4e3f-b474-7cc9412e273d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:03.762761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3a3f0a4-b5b4-4e3f-b474-7cc9412e273d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:03.819670 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3a3f0a4-b5b4-4e3f-b474-7cc9412e273d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:03.827657 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3a3f0a4-b5b4-4e3f-b474-7cc9412e273d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1094 microversion: 2.1 time: 0.069471 Sep 26 01:46:03.828210 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 557/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:03 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:04.519850 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:04.520385 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:04.527009 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.527496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.527937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.528650 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.529742 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.530274 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.555028 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:46:04.628957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-cc3a86ab-8bae-4892-a908-e38f4a7c60dc tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 204 len: 0 microversion: 2.1 time: 0.112654 Sep 26 01:46:04.629564 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 565/1122] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:04 2022] DELETE /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:46:04.637763 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:04.638561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:04.645231 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.645715 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.646149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.646837 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.647445 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.647879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.784039 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:04.792474 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a575ad2-4c67-4d70-8bfa-dacf4c1b1b76 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1552 microversion: 2.1 time: 0.158497 Sep 26 01:46:04.793037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 558/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:04 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:04.850517 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:04.851211 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:04.857739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.858526 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.858959 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.859638 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:04.860083 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:04.860538 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:04.979608 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:04.988015 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-3c4be4de-adb5-49b4-b20b-c008997cb421 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1200 microversion: 2.1 time: 0.141670 Sep 26 01:46:04.988621 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 566/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:04 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1200 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:05.816742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:05.817406 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:05.823770 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:05.824254 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:05.824722 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:05.825414 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:05.826405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:05.826924 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:05.954727 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:05.962373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3370f390-bf7f-47da-a0a8-eda9697ed9c0 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1552 microversion: 2.1 time: 0.149635 Sep 26 01:46:05.962937 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 559/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:05 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:06.011019 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:06.011624 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:06.018985 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:06.019468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:06.019897 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:06.020605 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:06.021050 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:06.021468 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:06.085309 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:06.093534 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8b14e354-b371-49f3-9362-29ec629ce9e3 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1200 microversion: 2.1 time: 0.086101 Sep 26 01:46:06.094357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 567/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:06 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:06.985429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:06.986873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:06.993537 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:06.995185 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:07.000015 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:07.001044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:07.001827 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:07.004867 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:07.117013 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:07.117627 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:07.125935 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:07.126357 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:07.126784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:07.131966 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:07.133080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:07.134178 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:07.301739 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d3321cdb59406da03c91fd8ec71885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b4276ece354a06b400b45e9e49186b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:07.312760 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6a16a66-7ec9-4b55-be53-fc37c977bce3 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 200 len: 1552 microversion: 2.1 time: 0.331067 Sep 26 01:46:07.313684 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 560/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:06 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 1552 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:07.395920 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:07.410368 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-48de19e5-f67e-45b1-a607-949eb7950c25 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1278 microversion: 2.1 time: 0.296282 Sep 26 01:46:07.421148 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 568/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:07 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:46:07.515904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e69c76-ef7a-4483-a6a0-f5ca65f98d22", "name": "network-vif-deleted", "tag": "3ca478bf-2db2-409b-939f-46e8d2591a1d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:07.525851 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:07.526338 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:07.526768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:07.538914 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] Creating event network-vif-deleted:3ca478bf-2db2-409b-939f-46e8d2591a1d for instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 on hv-cinder-85920 Sep 26 01:46:07.544288 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d4429706-7307-4476-b9f3-e56504137134 req-14f6ee7d-368f-4043-b369-04f52b75e4f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Sep 26 01:46:07.545308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 561/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:08.167227 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bc890d-5499-4e26-b8be-616f85d3c822", "tag": "d87f1ce7-0e22-4d36-b599-eda657e335c3"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:08.177780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:08.178257 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:08.178693 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:08.204782 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] Creating event network-changed:d87f1ce7-0e22-4d36-b599-eda657e335c3 for instance f7bc890d-5499-4e26-b8be-616f85d3c822 on hv-cinder-85920 Sep 26 01:46:08.210236 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-ce1a7d69-1217-490f-9e45-57f8437737a1 req-7f6c8e8c-2ff3-465a-add4-3f59881e88a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046937 Sep 26 01:46:08.211364 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 569/1130] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:46:08.338719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:08.339415 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] [instance: 76e69c76-ef7a-4483-a6a0-f5ca65f98d22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:08.345904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:08.346069 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:08.346509 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:08.347208 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:08.347658 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:08.348080 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:08.361612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] HTTP exception thrown: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Request method failure captured: Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 HTTP/1.1 Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQPVmrdingHgbdo_8fBxgVV7BuuMP8w4UdGFvIFjVUmfKOJ-d_BLBsu1fZBsxjOeQ6cV7DL7GsbHZGBXCeJS8bTPFRQ725LWBBbx2oHATWIk3TAVMJfsYbJJioxfT3yLcMDMXAudSZzEQLRJXmeynSfpg34gxrjdObQKkMoNzu89X-Y Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 63b4276ece354a06b400b45e9e49186b Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:08.363297 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/63b4276ece354a06b400b45e9e49186b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_63b4276ece354a06b400b45e9e49186b", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 63b4276ece354a06b400b45e9e49186b Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444211625 Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-1444211625-project Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: e1d3321cdb59406da03c91fd8ec71885 Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-1444211625-project Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. Sep 26 01:46:08.365035 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '76e69c76-ef7a-4483-a6a0-f5ca65f98d22'} Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:08.365882 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. Sep 26 01:46:08.367225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:08.368444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Returning 404 to user: Instance 76e69c76-ef7a-4483-a6a0-f5ca65f98d22 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:08.368444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7eaa77d9-7a2e-4ff4-9662-c77fa9dd61fe tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22" status: 404 len: 111 microversion: 2.1 time: 0.030706 Sep 26 01:46:08.368444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 562/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:08 2022] GET /compute/v2.1/servers/76e69c76-ef7a-4483-a6a0-f5ca65f98d22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:08.375382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6339486f-b6c4-4258-b98f-e33314210c58 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] Calling method '.version_select at 0x7f29d36af670>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:08.394741 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6339486f-b6c4-4258-b98f-e33314210c58 tempest-TestMinimumBasicScenario-1444211625 tempest-TestMinimumBasicScenario-1444211625-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1755112190" status: 202 len: 0 microversion: 2.1 time: 0.024236 Sep 26 01:46:08.395324 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 570/1132] 10.222.0.25 () {58 vars in 1272 bytes} [Mon Sep 26 01:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1755112190 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:46:08.433516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:08.434123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:08.440736 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:08.441223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:08.441655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:08.442352 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:08.442803 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:08.443225 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:08.596744 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:08.604955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02910733-92e2-4633-8412-7bda5f09ec18 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.175146 Sep 26 01:46:08.605704 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 563/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:08 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:09.629776 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:09.630456 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:09.637395 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:09.637891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:09.638337 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:09.639054 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:09.639516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:09.639944 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:09.945370 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:09.953770 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2ce14f04-82dc-4c66-b935-c04dd208afc4 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.327973 Sep 26 01:46:09.954344 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 571/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:09 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:10.978323 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:10.979087 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:10.987941 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:10.988463 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:10.988928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:10.989623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:10.990075 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:10.990563 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:11.143113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:11.151200 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04157158-30ea-4052-a82f-ad1144a55b1f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.178522 Sep 26 01:46:11.151767 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 564/1135] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:10 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:12.174843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:12.176834 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:12.179366 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:12.184864 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:12.185916 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:12.186523 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:12.187230 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:12.187687 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:12.188116 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:12.361284 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:12.369168 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-15d1c95a-9cb7-42af-901a-e5e5e3ab6360 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.198516 Sep 26 01:46:12.369750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 572/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:12 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:13.393429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:13.394176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:13.396799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:13.402260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:13.402762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:13.403201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:13.404651 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:13.405123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:13.405668 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:13.548599 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:13.556245 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a51573dd-ff6f-427b-a612-d2b8e314eb44 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.166811 Sep 26 01:46:13.556859 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 565/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:13 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:46:14.579599 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:14.580150 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:14.582492 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:14.583540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell0:SELECT=6 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:14.589365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:14.589898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:14.590363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:14.591071 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:14.591653 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:14.592333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:14.810804 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:14.823866 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-9845fece-a71e-491c-be76-885c47413bce tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.248360 Sep 26 01:46:14.824971 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 573/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:14 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:15.847125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:15.847671 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:15.849485 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:15.855443 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:15.855923 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:15.856375 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:15.857078 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:15.857520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:15.857955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:15.862098 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:16.024828 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:16.034444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b93a738f-e4ba-47f8-a65c-404b1a18ee38 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.191156 Sep 26 01:46:16.035342 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 566/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:15 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:17.058077 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:17.058694 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:17.065892 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:17.066382 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:17.066821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:17.067525 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:17.067978 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:17.068434 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:17.072410 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:17.201748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:17.209319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-2505a537-5ccd-4253-b389-748987092af0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.155129 Sep 26 01:46:17.209876 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 574/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:17 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:18.233416 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:18.234032 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:18.240157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:18.240678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:18.241123 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:18.241824 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:18.242284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:18.242716 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:18.371836 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:18.379464 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7272e5c1-d693-42a8-b00c-468582559795 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.150673 Sep 26 01:46:18.380025 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 567/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:18 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:19.402678 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:19.403286 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:19.409908 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:19.410393 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:19.410821 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:19.411504 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:19.411952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:19.412397 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:19.434047 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bc890d-5499-4e26-b8be-616f85d3c822", "name": "network-vif-plugged", "status": "completed", "tag": "d87f1ce7-0e22-4d36-b599-eda657e335c3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:19.445144 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:19.445730 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:19.446204 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:19.470769 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] Creating event network-vif-plugged:d87f1ce7-0e22-4d36-b599-eda657e335c3 for instance f7bc890d-5499-4e26-b8be-616f85d3c822 on hv-cinder-85920 Sep 26 01:46:19.476091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e458f931-b9e3-44fb-9e51-c466f63e921b req-b5465e7c-abad-4c09-8731-64818731364d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046618 Sep 26 01:46:19.476919 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 568/1142] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:46:19.563467 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:19.571724 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f9504094-f323-45d7-8a86-f9f7b1c82193 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.172776 Sep 26 01:46:19.572462 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 575/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:19 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:20.597274 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:20.597968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:20.604091 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:20.604606 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:20.605040 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:20.605725 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:20.606180 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:20.606605 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:20.739541 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:20.747202 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-677aa8d7-f6d7-4bcf-931c-7553ee214e4e tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1266 microversion: 2.1 time: 0.155344 Sep 26 01:46:20.748433 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 569/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:20 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:21.770748 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:21.771326 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:21.777769 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:21.778256 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:21.778721 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:21.780146 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:21.780630 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:21.781060 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:21.917378 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:21.925655 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-21f4c10a-efa8-4a86-ba27-74bcf1d106e6 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1453 microversion: 2.1 time: 0.158885 Sep 26 01:46:21.926260 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 576/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:21 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:21.947947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:21.948592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:21.955036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:21.955520 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:21.955955 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:21.956680 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:21.957134 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:21.957557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:22.088962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:22.097237 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da835b6c-f08c-4445-b025-d4bc5ef7c903 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1453 microversion: 2.1 time: 0.153199 Sep 26 01:46:22.097796 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 570/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:21 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:23.930863 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bc890d-5499-4e26-b8be-616f85d3c822", "tag": "d87f1ce7-0e22-4d36-b599-eda657e335c3"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:23.941540 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:23.942105 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:23.942593 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:23.955162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] Creating event network-changed:d87f1ce7-0e22-4d36-b599-eda657e335c3 for instance f7bc890d-5499-4e26-b8be-616f85d3c822 on hv-cinder-85920 Sep 26 01:46:23.960455 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-be561151-8b4e-4208-ae76-32cad947c265 req-b25d42ee-6fb4-457e-b199-f6e101b49fa1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033264 Sep 26 01:46:23.961126 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 577/1147] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:30.803965 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:30.804506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:30.811762 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:30.812235 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:30.812689 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:30.813378 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:30.813826 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:30.814246 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:30.837747 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-045ef516-1a3c-4bee-9e67-014b60cbd1c1 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/ips" status: 200 len: 149 microversion: 2.1 time: 0.037621 Sep 26 01:46:30.838308 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 571/1148] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Sep 26 01:46:30 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:32.168674 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "057a9b04-20e9-41ff-a3d3-0a291c431ed7"}} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:32.171829 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:32.178162 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:32.178635 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:32.179056 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:32.179729 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:32.180172 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:32.180616 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:32.417012 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-facc17c9-e1c2-4342-8eb1-9678ee6e4f11 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "POST /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253547 Sep 26 01:46:32.417607 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 578/1149] 10.222.0.25 () {60 vars in 1323 bytes} [Mon Sep 26 01:46:32 2022] POST /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:40.066810 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:40.067330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:40.073862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:40.074339 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:40.074771 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:40.075448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:40.075898 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:40.076315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:40.155656 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lazy-loading 'services' on Instance uuid c6f62aff-61a8-4ce7-af39-f5f588352f21 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:46:40.225908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6b54c1d-a798-4d41-846f-f340858a1028 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments/057a9b04-20e9-41ff-a3d3-0a291c431ed7" status: 202 len: 0 microversion: 2.1 time: 0.164092 Sep 26 01:46:40.226493 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 572/1150] 10.222.0.25 () {58 vars in 1416 bytes} [Mon Sep 26 01:46:40 2022] DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments/057a9b04-20e9-41ff-a3d3-0a291c431ed7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:46:40.236519 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:40.238888 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:40.245281 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:40.245768 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:40.246266 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:40.246911 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:40.247363 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:40.247784 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:40.278895 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-6c57cee1-7173-4024-b351-e7279e360a7d tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047821 Sep 26 01:46:40.279459 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 579/1151] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:46:40 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:41.292055 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:41.294309 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:41.301447 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.301951 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.302377 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.303062 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.303508 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.303928 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.336411 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9ddbc32-d577-48b4-814c-4fe3bb650c65 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048730 Sep 26 01:46:41.336978 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 573/1152] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Sep 26 01:46:41 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 01:46:41.399000 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:41.399503 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:41.405812 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.406299 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.406736 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.407427 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.407880 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.408303 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.432548 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:46:41.509991 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-ad16ff10-6181-4e21-8e9c-00de8cf54be2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 204 len: 0 microversion: 2.1 time: 0.114436 Sep 26 01:46:41.510833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 580/1153] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:41 2022] DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:46:41.519223 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:41.519831 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:41.525677 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.526157 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.526596 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.527284 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:41.527731 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:41.528154 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:41.657710 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:41.665500 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5fa9616-bc5d-40ac-b03f-73597c3027a0 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1682 microversion: 2.1 time: 0.150231 Sep 26 01:46:41.666064 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 574/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:41 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:42.690253 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:42.690962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:42.693469 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:42.698808 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:42.699297 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:42.699737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:42.700450 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:42.700907 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:42.701331 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:42.835711 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:42.844101 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-8c27d406-5054-4ec5-b983-f367243b626e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1682 microversion: 2.1 time: 0.158378 Sep 26 01:46:42.844697 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 581/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:42 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:43.867224 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:43.867766 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:43.870199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:43.875962 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:43.876506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:43.876947 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:43.877678 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:43.878136 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:43.878561 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:43.943316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64c98c1da1a847389fa035d86f6326de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e247930abd14072b8dfab4043d3e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:46:43.951020 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62db2779-316d-4890-b7b4-f795724c7b28 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 200 len: 1614 microversion: 2.1 time: 0.087810 Sep 26 01:46:43.951592 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 575/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:43 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:46:44.058265 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f62aff-61a8-4ce7-af39-f5f588352f21", "name": "network-vif-deleted", "tag": "f18080d2-eefc-4329-b872-de34c2711ea0"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:46:44.069336 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:44.075652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:44.076449 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:44.089843 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] Creating event network-vif-deleted:f18080d2-eefc-4329-b872-de34c2711ea0 for instance c6f62aff-61a8-4ce7-af39-f5f588352f21 on hv-cinder-85920 Sep 26 01:46:44.095113 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-cb9ac89d-fa90-4eea-8fad-ce599c175a2c req-67ae9e9f-ec7e-460b-ae28-8494b98cccea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040548 Sep 26 01:46:44.096516 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 582/1157] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:46:44.975625 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:44.976294 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:44.982689 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:44.983175 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:44.983612 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:44.984968 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:44.985452 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:44.985896 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:44.999518 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 HTTP/1.1 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:45.001353 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:45.003205 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c6f62aff-61a8-4ce7-af39-f5f588352f21'} Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:45.004044 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:45.005761 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:45.007409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:45.007409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1f4d36f-97d5-4e9d-8335-0ae9d5eee761 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 404 len: 111 microversion: 2.1 time: 0.031055 Sep 26 01:46:45.007409 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 576/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:44 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:45.012606 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-f5febd8a-b54a-4cf6-87f4-a774619d6ae8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '.version_select at 0x7f29d3c38b80>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:45.032194 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-f5febd8a-b54a-4cf6-87f4-a774619d6ae8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618086432" status: 202 len: 0 microversion: 2.1 time: 0.023749 Sep 26 01:46:45.032820 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Sep 26 01:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618086432 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 01:46:46.777782 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:46.778281 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:46.785735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:46.786260 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:46.786934 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:46.787723 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:46.788219 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:46.788721 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:46.791330 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:46.804196 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 HTTP/1.1 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:46.805753 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.807371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'c6f62aff-61a8-4ce7-af39-f5f588352f21'} Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:46.808305 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.809872 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.811547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:46.811547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54d0aefb-2fa3-4f3c-a154-fe65b4a53301 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 404 len: 111 microversion: 2.1 time: 0.033138 Sep 26 01:46:46.811547 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 577/1160] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:46 2022] DELETE /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:46.816878 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:46.817614 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: c6f62aff-61a8-4ce7-af39-f5f588352f21] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:46.827023 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:46.827500 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:46.828502 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:46.829425 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:46.829872 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:46.830290 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:46.842875 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 HTTP/1.1 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:46:46.845399 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.847018 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'c6f62aff-61a8-4ce7-af39-f5f588352f21'} Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:46.847952 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. Sep 26 01:46:46.849499 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:46.850912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance c6f62aff-61a8-4ce7-af39-f5f588352f21 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:46.850912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e8acf76b-e306-4250-b16b-0aae7e3ac5e8 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21" status: 404 len: 111 microversion: 2.1 time: 0.035059 Sep 26 01:46:46.850912 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 584/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:46 2022] GET /compute/v2.1/servers/c6f62aff-61a8-4ce7-af39-f5f588352f21 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:47.984711 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:47.985203 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:47.991552 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:47.992034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:47.992502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:47.993201 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:47.993655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:47.994085 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.007913 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf HTTP/1.1 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:48.009470 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.011102 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'b264a55d-6093-4e76-b67b-79197f8e4dbf'} Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:48.012009 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.013556 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.015095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:48.015095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c6b34fa-58e9-4132-b2d5-1587ef93543b tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 404 len: 111 microversion: 2.1 time: 0.030180 Sep 26 01:46:48.015095 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 578/1162] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:47 2022] DELETE /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:48.020477 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:48.021087 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: b264a55d-6093-4e76-b67b-79197f8e4dbf] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:48.027365 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.027839 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.028263 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.028957 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.029402 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.029817 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.032637 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:46:48.044891 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf HTTP/1.1 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:46:48.046414 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.048167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': 'b264a55d-6093-4e76-b67b-79197f8e4dbf'} Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:48.049036 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. Sep 26 01:46:48.050666 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.052255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance b264a55d-6093-4e76-b67b-79197f8e4dbf could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:48.052255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-45a9b915-9731-4223-997c-754019e09b7f tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf" status: 404 len: 111 microversion: 2.1 time: 0.031434 Sep 26 01:46:48.052255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 585/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:48 2022] GET /compute/v2.1/servers/b264a55d-6093-4e76-b67b-79197f8e4dbf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 01:46:48.056980 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:48.057477 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:48.064177 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.064679 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.065113 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.065799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.066248 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.066673 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.080374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a HTTP/1.1 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:48.081876 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.083317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '9d2665e6-6873-4c15-8efc-65665e9a6a5a'} Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:48.084101 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.085621 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.087429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:48.087429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7075c34-f553-4aab-8baa-74e291a4038e tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 404 len: 111 microversion: 2.1 time: 0.030076 Sep 26 01:46:48.087429 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 579/1164] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:48 2022] DELETE /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:48.092496 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:48.093095 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 9d2665e6-6873-4c15-8efc-65665e9a6a5a] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:48.099801 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.100278 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.100734 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.101411 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:48.101853 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:48.102269 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:48.115819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a HTTP/1.1 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:46:48.117351 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.119021 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '9d2665e6-6873-4c15-8efc-65665e9a6a5a'} Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:48.119937 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. Sep 26 01:46:48.121487 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:48.122854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 9d2665e6-6873-4c15-8efc-65665e9a6a5a could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:48.122854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-c70fa433-1166-4a02-adc5-7cc80524c43c tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a" status: 404 len: 111 microversion: 2.1 time: 0.030964 Sep 26 01:46:48.122854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 586/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:48 2022] GET /compute/v2.1/servers/9d2665e6-6873-4c15-8efc-65665e9a6a5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:46:49.429765 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:49.430277 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:49.436587 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:49.437072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:49.438317 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:49.439006 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:49.439450 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:49.439873 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:49.453742 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 HTTP/1.1 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:46:49.455268 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.457016 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '3064a59e-2e5b-4254-bf1d-c76b549b31c6'} Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:49.457946 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.459448 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.461072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:49.461072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0df13912-4437-41bd-8f6f-865dc8264795 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 404 len: 111 microversion: 2.1 time: 0.030806 Sep 26 01:46:49.461072 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 580/1166] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:46:49 2022] DELETE /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 01:46:49.465128 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:46:49.465743 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] [instance: 3064a59e-2e5b-4254-bf1d-c76b549b31c6] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:46:49.472210 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:49.472739 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:49.473179 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:49.473867 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:46:49.474322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:46:49.474747 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:46:49.488002 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] HTTP exception thrown: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Request method failure captured: Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 HTTP/1.1 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQN8BhwhwwTq3HuDhCD2ICPyasvJ4za0WzML9Brw5dxzcG21mdRQB-A_ZECfYr6U3nyeTsGCFb47Qluun6lDvTLI3Jy5L5mULoIm0qONC52viJYHiV3pobYKP5cnEiyVrYd9EwtKF-KuJVmCzxmBvbGo1e8awmt5Jx2QHRwJMMkkbRQ Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:46:49.489562 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7e247930abd14072b8dfab4043d3e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7e247930abd14072b8dfab4043d3e3f5", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 7e247930abd14072b8dfab4043d3e3f5 Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1219679579 Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: 64c98c1da1a847389fa035d86f6326de Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-AttachVolumeNegativeTest-1219679579-project Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.491191 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '3064a59e-2e5b-4254-bf1d-c76b549b31c6'} Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:46:49.495339 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. Sep 26 01:46:49.497325 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:46:49.498715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] Returning 404 to user: Instance 3064a59e-2e5b-4254-bf1d-c76b549b31c6 could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:46:49.498715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-e86ec9fc-4f4a-4e03-8db2-ce3114fe1ac2 tempest-AttachVolumeNegativeTest-1219679579 tempest-AttachVolumeNegativeTest-1219679579-project] 10.222.0.25 "GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6" status: 404 len: 111 microversion: 2.1 time: 0.029666 Sep 26 01:46:49.498715 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 587/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:46:49 2022] GET /compute/v2.1/servers/3064a59e-2e5b-4254-bf1d-c76b549b31c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:48:01.044635 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=11 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:01.045187 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:01.045560 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:01.046267 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG dbcounter [-] [127126] Writing DB stats nova_cell1:SELECT=5 {{(pid=127126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 01:48:01.049899 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:01.050544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bc890d-5499-4e26-b8be-616f85d3c822", "tag": "d87f1ce7-0e22-4d36-b599-eda657e335c3"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:48:01.050655 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:01.058240 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:01.058726 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:01.059158 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:01.059861 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:01.060316 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:01.060799 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:01.072780 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:01.073354 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:01.073879 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:01.087346 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] Creating event network-changed:d87f1ce7-0e22-4d36-b599-eda657e335c3 for instance f7bc890d-5499-4e26-b8be-616f85d3c822 on hv-cinder-85920 Sep 26 01:48:01.089879 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:48:01.092686 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-9ada1e90-d37d-4520-8f55-59fa9a9337f3 req-75a81c9f-d740-48f3-a97a-08b72df050d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049402 Sep 26 01:48:01.093627 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 588/1168] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:48:01.173486 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4dc4852-d350-410f-85c4-bcce3e8ab07f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 204 len: 0 microversion: 2.1 time: 0.131645 Sep 26 01:48:01.178334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 581/1169] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:48:01 2022] DELETE /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:48:01.185854 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:01.186571 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:01.193582 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:01.194265 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:01.194709 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:01.195421 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:01.195877 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:01.196307 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:01.328898 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:01.337249 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-a2d7875e-dfa8-40c0-9d71-27fceda65b6b tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1577 microversion: 2.1 time: 0.158030 Sep 26 01:48:01.337826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 589/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:01 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:48:02.361589 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:02.362199 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:02.368701 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:02.369183 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:02.369623 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:02.370345 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:02.370794 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:02.371221 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:02.509126 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:02.516816 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2566adce-9632-4cf9-b20b-19e68358c528 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1577 microversion: 2.1 time: 0.159606 Sep 26 01:48:02.517374 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 582/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:02 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:48:03.541581 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:03.542315 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:03.548618 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:03.549111 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:03.549546 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:03.550234 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:03.550699 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:03.551125 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:03.617193 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:03.625027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25e1a69a-db94-4e72-918b-4b859d0f5adf tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 200 len: 1225 microversion: 2.1 time: 0.087188 Sep 26 01:48:03.625664 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 583/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:03 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 01:48:03.626123 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bc890d-5499-4e26-b8be-616f85d3c822", "name": "network-vif-deleted", "tag": "d87f1ce7-0e22-4d36-b599-eda657e335c3"}]} {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:48:03.635652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:03.636130 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:03.636588 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:03.647144 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.compute.server_external_events [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] Creating event network-vif-deleted:d87f1ce7-0e22-4d36-b599-eda657e335c3 for instance f7bc890d-5499-4e26-b8be-616f85d3c822 on hv-cinder-85920 Sep 26 01:48:03.651778 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [req-1cf7dd4e-47b1-46e0-812b-9476b1980f58 req-2f378912-6970-4cfa-b805-ae80f7b5ff23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208710 Sep 26 01:48:03.652369 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 590/1173] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:48:04.648600 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:04.649191 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: f7bc890d-5499-4e26-b8be-616f85d3c822] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:04.655594 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:04.656082 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:04.656557 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:04.657264 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:04.657719 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:04.658149 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:04.672502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] HTTP exception thrown: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Request method failure captured: Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 HTTP/1.1 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQMoI6BfgIrnFHyNozyJGTjRJM83LNx28IVsWDFwxuHaogVOg_NB8ydQs9re6B_-AU8mj2YezohnKCaNtfXj9dauu90r8jids35H5l0ZqFzD1fOH1mJcmgev75mek1tYFNTGso8MJxIFSxzHWQOiUfJhKGAqg_wpswHSz4oZK0BR_ro Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:48:04.674036 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/786ed33f027946f581147e672b947df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_786ed33f027946f581147e672b947df0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: a47ec612bce54bc8b2062b03d36d10d4 Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. Sep 26 01:48:04.675775 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': 'f7bc890d-5499-4e26-b8be-616f85d3c822'} Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:48:04.677081 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. Sep 26 01:48:04.678950 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:04.680735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Returning 404 to user: Instance f7bc890d-5499-4e26-b8be-616f85d3c822 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:48:04.680735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8748eb9-56e8-4183-ae79-a7b39e1112b0 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822" status: 404 len: 111 microversion: 2.1 time: 0.031245 Sep 26 01:48:04.680735 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 584/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:04 2022] GET /compute/v2.1/servers/f7bc890d-5499-4e26-b8be-616f85d3c822 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:48:07.731671 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:07.732272 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad4ef30-98fb-408a-8a13-e78e64481234", "tag": "8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:48:07.732997 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:07.739333 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:07.739883 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:07.740597 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:07.741544 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:07.742094 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:07.742506 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:07.742652 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:07.742981 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:07.743643 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:07.754841 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] Creating event network-changed:8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8 for instance 2ad4ef30-98fb-408a-8a13-e78e64481234 on hv-cinder-85920 Sep 26 01:48:07.760582 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-96f158f7-0490-44ec-a013-cfed55f2ec91 req-731d438f-f259-4b9c-87ac-6f20ae04e8a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Sep 26 01:48:07.761516 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 585/1175] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 01:48:07.768431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Going to try to terminate instance {{(pid=127126) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 01:48:07.869405 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-eeaaa323-c5be-4b89-a88b-c7dd97c5120f tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 204 len: 0 microversion: 2.1 time: 0.142346 Sep 26 01:48:07.870826 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 591/1176] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:48:07 2022] DELETE /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 01:48:07.879343 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:07.880037 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:07.896152 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:07.897027 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:07.897817 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:07.898598 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:07.899262 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:07.899768 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:08.055862 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.policy [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:08.064104 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67cb2602-7dd1-4d9a-8fc9-f2df9921c258 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1580 microversion: 2.1 time: 0.189062 Sep 26 01:48:08.064749 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 586/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:07 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1580 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:48:09.088080 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:09.088932 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:09.095259 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:09.095722 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:09.096157 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:09.096936 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:09.097389 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:09.097811 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:09.255675 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:09.264373 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-4aa4e4d9-81c5-4415-a0ab-f2a27354883d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1580 microversion: 2.1 time: 0.180436 Sep 26 01:48:09.264962 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 592/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:09 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1580 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:48:10.029856 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad4ef30-98fb-408a-8a13-e78e64481234", "name": "network-vif-deleted", "tag": "8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 01:48:10.040698 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:10.041176 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:10.041661 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:10.054048 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] Creating event network-vif-deleted:8f5bab4b-d8e6-4f83-9ec5-ca52a0b501c8 for instance 2ad4ef30-98fb-408a-8a13-e78e64481234 on hv-cinder-85920 Sep 26 01:48:10.059858 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7de790a7-da42-4557-93a8-ea1acc46bece req-90d37a96-b06e-4e8d-86d9-92f20a3f5a8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033661 Sep 26 01:48:10.060487 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 587/1179] 10.222.0.25 () {64 vars in 1317 bytes} [Mon Sep 26 01:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 01:48:10.290182 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:10.291167 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:10.300253 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:10.300833 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:10.301676 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:10.302577 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:10.303003 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:10.304557 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:10.341332 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:10.341819 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:10.342248 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:10.342974 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.objects.instance [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lazy-loading 'fault' on Instance uuid 2ad4ef30-98fb-408a-8a13-e78e64481234 {{(pid=127126) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 01:48:10.391498 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.policy [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47ec612bce54bc8b2062b03d36d10d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786ed33f027946f581147e672b947df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127126) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 01:48:10.400466 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-5acfb2a0-618d-404e-a8ce-0882b64fe02a tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 200 len: 1231 microversion: 2.1 time: 0.116117 Sep 26 01:48:10.401034 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 593/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:10 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 01:48:11.425749 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:11.426373 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 2ad4ef30-98fb-408a-8a13-e78e64481234] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:11.432815 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.433306 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.433748 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.434444 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.434902 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.435334 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.448591 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] HTTP exception thrown: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Request method failure captured: Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 HTTP/1.1 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQMoI6BfgIrnFHyNozyJGTjRJM83LNx28IVsWDFwxuHaogVOg_NB8ydQs9re6B_-AU8mj2YezohnKCaNtfXj9dauu90r8jids35H5l0ZqFzD1fOH1mJcmgev75mek1tYFNTGso8MJxIFSxzHWQOiUfJhKGAqg_wpswHSz4oZK0BR_ro Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:48:11.450194 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/786ed33f027946f581147e672b947df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_786ed33f027946f581147e672b947df0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: a47ec612bce54bc8b2062b03d36d10d4 Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. Sep 26 01:48:11.451833 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '2ad4ef30-98fb-408a-8a13-e78e64481234'} Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:48:11.452787 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. Sep 26 01:48:11.454405 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.455984 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Returning 404 to user: Instance 2ad4ef30-98fb-408a-8a13-e78e64481234 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:48:11.455984 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8776b683-4340-403e-9eb2-dc3dd08e0228 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 26 01:48:11.455984 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 588/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:11 2022] GET /compute/v2.1/servers/2ad4ef30-98fb-408a-8a13-e78e64481234 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:48:11.892994 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:11.893553 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.compute.api [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127126) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:11.899781 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.900270 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.900737 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.901431 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.901893 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.902319 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG oslo_concurrency.lockutils [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127126) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.916255 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.wsgi [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] HTTP exception thrown: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Request method failure captured: Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: request: DELETE /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d HTTP/1.1 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept: application/json Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Accept-Encoding: identity Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Connection: close Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Length: 0 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Content-Type: application/json Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Host: 10.222.0.25 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: Openstack-System-Scope: None Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: User-Agent: python-urllib3/1.26.12 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Auth-Token: gAAAAABjMQMoI6BfgIrnFHyNozyJGTjRJM83LNx28IVsWDFwxuHaogVOg_NB8ydQs9re6B_-AU8mj2YezohnKCaNtfXj9dauu90r8jids35H5l0ZqFzD1fOH1mJcmgev75mek1tYFNTGso8MJxIFSxzHWQOiUfJhKGAqg_wpswHSz4oZK0BR_ro Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Id: None Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Domain-Name: None Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Identity-Status: Confirmed Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Is-Admin-Project: True Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Id: default Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Domain-Name: Default Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Project-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Role: member,reader Sep 26 01:48:11.917943 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Roles: member,reader Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/786ed33f027946f581147e672b947df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_786ed33f027946f581147e672b947df0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-Tenant-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Id: default Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Domain-Name: Default Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Id: a47ec612bce54bc8b2062b03d36d10d4 Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: X-User-Name: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: method: > Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: exception: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.919750 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: action_args: {'id': '86741c60-35b0-4105-9c2d-3f667824cd4d'} Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:48:11.920923 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.922549 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.924322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Returning 404 to user: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. {{(pid=127126) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:48:11.924322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-99cfc04f-f33d-4fda-bfb0-bf68b562c451 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 404 len: 111 microversion: 2.1 time: 0.030506 Sep 26 01:48:11.924322 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 594/1182] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Sep 26 01:48:11 2022] DELETE /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:48:11.927778 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:11.928502 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] [instance: 86741c60-35b0-4105-9c2d-3f667824cd4d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 01:48:11.934371 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.934857 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.935296 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.935985 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Acquiring lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 01:48:11.936478 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 01:48:11.936908 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Lock "c12c9fd8-f951-4e80-91ce-c97b9492891c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 01:48:11.950507 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] HTTP exception thrown: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Request method failure captured: Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d HTTP/1.1 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept: application/json Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Accept-Encoding: identity Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Connection: close Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Length: 0 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Content-Type: application/json Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Host: 10.222.0.25 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: Openstack-System-Scope: None Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjMQMoI6BfgIrnFHyNozyJGTjRJM83LNx28IVsWDFwxuHaogVOg_NB8ydQs9re6B_-AU8mj2YezohnKCaNtfXj9dauu90r8jids35H5l0ZqFzD1fOH1mJcmgev75mek1tYFNTGso8MJxIFSxzHWQOiUfJhKGAqg_wpswHSz4oZK0BR_ro Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Id: None Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Domain-Name: None Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Identity-Status: Confirmed Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Is-Admin-Project: True Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Id: default Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Domain-Name: Default Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Role: member,reader Sep 26 01:48:11.952034 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Roles: member,reader Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/786ed33f027946f581147e672b947df0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/786ed33f027946f581147e672b947df0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_786ed33f027946f581147e672b947df0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}] Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Id: 786ed33f027946f581147e672b947df0 Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-348240511 Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Id: default Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Domain-Name: Default Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Id: a47ec612bce54bc8b2062b03d36d10d4 Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-348240511-project Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: method: > Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: exception: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.953791 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: action_args: {'id': '86741c60-35b0-4105-9c2d-3f667824cd4d'} Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 01:48:11.954904 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. Sep 26 01:48:11.956540 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Sep 26 01:48:11.958242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Returning 404 to user: Instance 86741c60-35b0-4105-9c2d-3f667824cd4d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 01:48:11.958242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89081c34-b4ce-43ca-87ff-b3caf6769e5d tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d" status: 404 len: 111 microversion: 2.1 time: 0.029425 Sep 26 01:48:11.958242 dv-cinder-859203-2-iscsi devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 589/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Sep 26 01:48:11 2022] GET /compute/v2.1/servers/86741c60-35b0-4105-9c2d-3f667824cd4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 01:48:13.246579 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: DEBUG nova.api.openstack.wsgi [None req-fc632234-121b-4d3d-b9af-210b2e5bc6d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] Calling method '.version_select at 0x7f29d39bb430>' {{(pid=127126) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 01:48:13.266859 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: INFO nova.api.openstack.requestlog [None req-fc632234-121b-4d3d-b9af-210b2e5bc6d2 tempest-TestVolumeBootPattern-348240511 tempest-TestVolumeBootPattern-348240511-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1126381645" status: 202 len: 0 microversion: 2.1 time: 0.023988 Sep 26 01:48:13.267632 dv-cinder-859203-2-iscsi devstack@n-api.service[127126]: [pid: 127126|app: 0|req: 595/1184] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Sep 26 01:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1126381645 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)